-- Logs begin at Wed 2022-06-29 15:17:15 UTC, end at Wed 2022-06-29 16:34:08 UTC. -- Jun 29 16:01:11.527158 dv-cinder-848147-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 16:01:11.535930 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 16:01:11 2022] *** Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: nodename: dv-cinder-848147-1-iscsi Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: machine: x86_64 Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: clock source: unix Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: pcre jit disabled Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: detected number of CPU cores: 4 Jun 29 16:01:11.537864 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: current working directory: / Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: detected binary path: /usr/bin/uwsgi-core Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: your processes number limit is 47680 Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: your memory page size is 4096 bytes Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: detected max file descriptor number: 2048 Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: lock engine: pthread robust mutexes Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: thunder lock: enabled Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 16:01:11.538472 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 16:01:11.581430 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: Python main interpreter initialized at 0x55ac3afd99c0 Jun 29 16:01:11.581430 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: python threads support enabled Jun 29 16:01:11.581430 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: your server socket listen backlog is limited to 100 connections Jun 29 16:01:11.581430 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: your mercy for graceful operations on workers is 90 seconds Jun 29 16:01:11.581744 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 16:01:11.581819 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: *** Operational MODE: preforking *** Jun 29 16:01:11.582079 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: *** uWSGI is running in multiple interpreter mode *** Jun 29 16:01:11.582079 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: spawned uWSGI master process (pid: 103208) Jun 29 16:01:11.584889 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: spawned uWSGI worker 1 (pid: 103209, cores: 1) Jun 29 16:01:11.584889 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: spawned uWSGI worker 2 (pid: 103210, cores: 1) Jun 29 16:01:11.584889 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 16:01:11.582258 dv-cinder-848147-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 16:01:12.235741 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 16:01:12.236831 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 16:01:13.356731 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:01:13.356731 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: from cryptography.utils import int_from_bytes Jun 29 16:01:13.357438 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:01:13.357438 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: from cryptography.utils import int_from_bytes Jun 29 16:01:13.357821 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:01:13.357821 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: from cryptography.utils import int_from_bytes Jun 29 16:01:13.358245 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:01:13.358245 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: from cryptography.utils import int_from_bytes Jun 29 16:01:15.824427 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 16:01:15.825007 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 16:01:15.825184 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 16:01:15.825285 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 16:01:15.825649 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 16:01:15.825737 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 16:01:15.825828 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 16:01:15.826046 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 16:01:15.826138 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.826412 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 16:01:15.826514 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.826669 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 16:01:15.826777 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.827055 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.827144 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.827377 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.827464 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.827685 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.827776 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828025 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828116 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828339 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828436 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828648 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828735 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828906 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.828999 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.829215 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.829319 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.829536 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848147-1-iscsi {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.829623 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.829823 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.829908 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.830136 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.830224 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.830440 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.830532 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848147-1-iscsi {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.830751 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.830839 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.831051 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.831149 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.831929 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.832029 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.832237 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.832323 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.832540 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.832730 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.832843 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.833875 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834008 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834008 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834240 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834390 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834477 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834602 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834734 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834827 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.834919 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835006 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835092 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835178 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835332 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835468 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835563 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835643 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835752 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.835867 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.836098 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.836239 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848147-1-iscsi {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.836405 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.836543 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.836713 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.836852 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.837107 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848147-1-iscsi {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.837235 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.837413 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.837543 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.837723 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.837843 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.838035 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.838181 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.838445 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.838537 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.838753 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.838840 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.839055 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.839192 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.839370 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.839468 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.839681 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.839872 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840015 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840110 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840328 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840421 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840626 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840722 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.840929 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841025 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841232 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841322 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841545 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841641 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841843 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.841941 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.842142 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.842237 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.842392 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.842481 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.842696 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.842782 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843014 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843101 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843266 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843353 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843573 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843658 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843896 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.843999 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.844149 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.844239 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.844471 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.844618 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.844775 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.844871 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845027 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845115 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845344 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845431 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845659 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845755 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.845963 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.846059 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.846268 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.846354 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.846571 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.846659 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.847410 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.847517 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.847726 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.847812 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848055 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848143 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848364 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848454 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848671 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848767 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.848972 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.849065 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.849288 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.849376 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.849606 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.849700 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.849915 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850001 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850217 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850301 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850550 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850646 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850860 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.850949 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.851159 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.851246 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.851471 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.851569 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.851787 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.851907 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.852114 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.852215 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.852416 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.852513 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.852719 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.852806 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853030 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853125 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853338 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853428 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853639 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853732 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853885 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.853972 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.854179 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.854268 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.854477 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.854563 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.854789 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.854886 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.855086 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.855173 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.855384 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.855470 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.855685 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.855771 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856020 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856147 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856316 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856425 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856617 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856706 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.856915 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857022 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857212 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857303 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857509 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857605 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857807 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.857894 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.858109 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.858193 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.858409 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.858524 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.858706 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.858792 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859010 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859096 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859318 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859423 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859616 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859708 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.859943 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860034 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860247 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860349 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860547 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860643 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860858 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.860970 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.861155 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.861266 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.861457 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.861564 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.861776 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.861873 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.862068 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.862163 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.862370 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.862456 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.863241 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.863349 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.863545 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.863643 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.863872 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.864046 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.864190 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.864326 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.864461 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.864612 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.864995 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.865142 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.865313 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.865458 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.865604 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.865742 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.865904 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866041 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866205 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866343 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866488 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866625 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866789 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.866928 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.867074 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.867210 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.867427 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.867566 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.867708 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.867909 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868015 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868162 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868270 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868360 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868560 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868650 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868856 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.868953 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.869157 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.869242 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.869457 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.869544 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.869769 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.869870 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.870073 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.870158 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.870382 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.870470 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.870706 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:01:15.870802 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.871040 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.871133 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.871395 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.871495 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.871694 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.871794 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872038 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872137 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872431 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872656 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872752 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.872976 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873064 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873283 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873379 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873591 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873679 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873898 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.873985 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.874212 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.874306 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.874522 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.874610 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.874839 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.874927 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.875148 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.875245 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.875460 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.875556 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.875775 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.875898 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.876108 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.876197 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.876420 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.876508 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.876736 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.876822 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.877048 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.877142 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.877354 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.877442 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.877682 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.877767 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878004 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878099 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878339 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878425 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878660 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878747 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.878976 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.879072 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.879284 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.879382 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.879589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.879677 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.879922 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880031 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880244 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880332 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880559 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880644 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880868 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.880964 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.881183 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.881273 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.881491 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.881578 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.881798 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.881897 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.882105 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.882200 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.882413 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.882500 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.882720 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.882808 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883030 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883124 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883345 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883433 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883653 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883741 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.883984 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.884087 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.884302 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.884390 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.884610 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.884699 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.884918 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885007 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885227 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885323 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885529 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885616 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885829 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.885916 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.886129 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.886234 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.886432 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.886532 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.886730 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.886816 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887031 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887130 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887342 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887429 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887645 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887777 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.887987 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.888088 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.888288 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.888376 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.888599 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.888686 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.888908 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889000 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889216 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889304 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889520 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889608 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889830 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.889921 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.890138 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.890224 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.890437 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.890523 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.890752 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.890846 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.891057 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.891143 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.891359 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.891453 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.891677 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.891802 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892005 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892095 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892306 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892404 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892616 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892711 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.892921 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893007 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893226 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893323 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893530 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893625 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893861 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.893949 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.894173 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.894268 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.894481 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.894568 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.894789 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.894875 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.895109 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.895204 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.895425 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.895521 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.895723 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.895811 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896066 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896156 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896387 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896474 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896700 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896796 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.896999 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897095 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897304 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897392 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897605 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897693 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897903 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.897999 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.898201 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.898296 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.898505 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.898593 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.898802 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.898936 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.899101 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.899188 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.899398 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.899495 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.899698 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.899787 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900022 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900111 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900323 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900422 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900629 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900716 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.900928 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901016 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901225 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901371 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901524 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901613 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901833 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.901969 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.902136 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.902239 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.902440 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.902528 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.902783 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.902870 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.903091 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.903181 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.903407 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.903494 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.903714 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.903801 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904051 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904143 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904358 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904447 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904663 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904750 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.904970 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905067 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905275 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905362 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905587 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905683 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905892 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.905980 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.906201 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.906286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.906504 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.906589 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.906817 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.906904 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.907119 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.907204 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.907432 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.907528 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.907735 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.907842 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.908080 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.908168 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.908397 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.908495 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.908703 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.908792 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.909020 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.909115 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.909334 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.909913 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.910148 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.910238 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.910459 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.910547 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.910764 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.910861 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.911068 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.911155 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.911374 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.911463 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.911681 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.911769 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912111 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912319 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912410 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912628 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912715 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.912932 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913026 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913245 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913331 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913549 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913644 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913861 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.913948 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.914158 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.914244 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.914467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.914556 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.914785 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.914870 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.915092 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.915178 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.915400 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.915489 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.915708 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.915798 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916048 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916151 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916356 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916451 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916663 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916750 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.916971 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917067 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917272 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917363 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917574 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917663 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917880 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.917981 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.918183 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.918269 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.918484 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.918609 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.918791 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.918956 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.919091 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.919178 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.919398 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.919486 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.919697 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.919785 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920025 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920112 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920323 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920408 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920629 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920719 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.920934 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921031 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921239 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921326 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921546 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921640 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921858 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.921944 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.922158 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.922245 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.922459 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.922547 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.922774 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.922870 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.923074 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.923169 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.923373 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.923467 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.923674 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.923762 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924001 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924104 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924306 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924400 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924614 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924702 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.924922 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.925046 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.925773 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.925874 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.926094 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.926182 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.926400 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.926501 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.926711 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.926798 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927019 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927107 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927327 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927416 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927641 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927726 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.927973 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928079 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928283 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928373 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928590 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928677 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928899 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.928986 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.929207 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.929296 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.929513 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.929599 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.929821 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.929915 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.930133 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.930220 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.930440 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.930535 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.930748 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.930844 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931048 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931136 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931354 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931440 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931663 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931758 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.931993 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.932261 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.932349 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.932594 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.932683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.932910 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.933159 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.933247 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.933495 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.933582 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.933815 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.933912 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.934136 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.934237 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.934457 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.934557 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.934776 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.934865 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.935084 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.935180 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.935393 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.935490 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.935697 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.935786 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936024 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936127 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936334 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936478 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936636 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936724 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.936936 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937034 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937235 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937330 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937543 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937631 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937844 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.937932 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.938142 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.938240 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.938444 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.938540 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.938745 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.938832 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939049 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939143 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939349 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939438 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939652 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939739 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.939978 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.940067 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.940281 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.940369 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.940610 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.940701 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.940915 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941003 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941216 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941312 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941516 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941605 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941826 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.941922 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.942131 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.942234 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.942438 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.942536 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.942776 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.942863 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.943082 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.943245 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.943403 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.943490 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.943705 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.943801 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944061 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944164 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944363 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944460 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944663 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944750 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.944963 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.945052 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.945269 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.945356 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.945574 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.945661 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.945873 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946182 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946268 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946485 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946570 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946786 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.946874 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.947089 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.947182 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.947389 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.947476 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.947695 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.947784 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948019 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948109 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948322 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948424 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948626 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948712 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.948927 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949014 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949226 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949326 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949532 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949623 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949836 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.949922 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.950140 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.950239 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.950443 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.950531 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.950743 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.950830 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951046 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951146 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951342 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951429 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951643 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951739 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.951967 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952060 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952270 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952357 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952574 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952671 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952872 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.952968 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.953180 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.953266 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.953485 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.953570 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.953786 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.953874 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954085 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954170 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954391 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954477 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954690 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954778 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.954988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.955075 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.955293 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.955392 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.955595 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.955689 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.955920 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.956048 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.956733 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.956848 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.957171 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.957305 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.957420 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.957507 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.957711 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.957811 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958026 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958114 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958332 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958420 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958633 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958732 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.958934 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959021 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959236 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959330 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959535 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959625 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959843 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.959932 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.960159 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.960245 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.960465 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.960563 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.960764 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.960851 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961067 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961155 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961367 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961456 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961673 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961759 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.961980 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.962081 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.962283 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.962373 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.962624 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.962719 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.962931 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963027 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963241 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963331 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963547 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963635 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963871 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.963978 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.964183 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.964271 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.964482 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.964570 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.964793 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.964890 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.965098 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.965186 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.965403 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.965489 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.965702 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.965803 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966001 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966088 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966316 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966415 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966619 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966715 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.966924 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967013 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967238 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967333 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967547 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967635 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967882 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.967974 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.968183 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.968272 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.968487 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.968576 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.968793 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.968880 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.969098 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.969185 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.969403 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.969500 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.969708 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.969799 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970016 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970102 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970319 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970406 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970625 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970714 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.970931 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.971033 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.971237 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.971332 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.971538 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.971632 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.971949 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.972697 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.972786 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.972868 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973072 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973164 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973381 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973477 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973688 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973776 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.973989 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974078 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974293 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974390 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974593 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974682 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974896 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.974982 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.975195 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.975283 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.975496 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.975619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.975808 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.975956 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.976132 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.976268 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.976557 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.976646 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.976861 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.976953 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.977168 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.977257 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.977472 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.977558 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.977779 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.977872 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.978083 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.978172 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.978396 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.978482 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.978709 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.978805 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.979018 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.979106 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.979385 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.979474 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.979708 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980033 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980128 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980433 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980668 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980767 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.980970 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981068 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981272 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981360 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981574 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981663 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981895 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.981984 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.982198 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.982284 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.982507 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.982603 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.982814 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.982912 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.983139 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.983228 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.983449 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.983551 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.983777 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.983928 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.984218 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.984308 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.984533 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.984629 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.984839 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.984933 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.985158 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.985254 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.985481 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.985570 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.985784 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.985871 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.986094 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.986190 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.986402 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.986512 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.986726 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.986825 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.987047 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.987136 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.987355 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.987480 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.987690 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.987781 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988016 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988119 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988337 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988434 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988656 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988746 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.988966 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.989055 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.989271 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.989366 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.989597 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.989686 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.990176 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.990278 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.990491 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.990578 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.990820 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.990910 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.991161 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.991248 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.991468 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.991565 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.991771 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.991878 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.992115 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.992204 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.992418 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.992523 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.992721 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.992858 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993041 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993134 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993346 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993445 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993656 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993744 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.993965 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994053 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994273 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994375 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994576 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994666 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994877 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.994964 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.995190 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.995279 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.995492 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.995579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.995798 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.995933 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.996130 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.996222 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.996448 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.996534 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.996754 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.996841 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997054 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997152 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997374 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997469 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997684 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997772 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.997985 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.998082 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.998287 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.998382 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.998589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.998685 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.998907 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999001 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999216 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999312 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999525 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999621 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999845 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:15.999937 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.000193 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.000314 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.000501 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.000614 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.000823 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.000922 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.001141 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.001237 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.001455 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.001553 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.001771 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.001868 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.002094 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.002191 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.002397 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.002495 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.002699 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.002797 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.003008 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.003162 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.003367 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.003472 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.003677 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.003774 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004011 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004109 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004316 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004405 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004617 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004705 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.004920 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005028 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005219 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005315 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005529 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005616 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005827 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.005938 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.006131 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.006217 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.006437 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.006538 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.006738 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.006847 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007038 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007126 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007338 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007426 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007662 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007757 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.007990 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.008078 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.008298 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.008386 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.008606 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.008695 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.008930 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009023 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009246 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009332 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009550 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009638 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009872 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.009960 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.010193 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.010292 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.010509 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.010613 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.010821 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.010913 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.011135 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.011223 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.011446 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.011535 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.011758 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.011928 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.012094 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.012183 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.012404 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.012495 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.012715 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.012802 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013027 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013120 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013342 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013447 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013654 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013862 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.013971 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.014184 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.014273 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.014494 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.014582 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.014804 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.015110 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.015210 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.015419 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.015514 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.015728 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.015816 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016065 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016154 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016369 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016454 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016675 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016777 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.016983 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.017127 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.017292 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.017388 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.017626 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.017733 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.017912 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.018003 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.018223 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.018322 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.018535 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.018640 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.019368 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.019459 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.019680 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.019768 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020016 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020117 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020368 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020502 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020770 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.020983 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021084 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021292 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021389 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021602 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021689 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021908 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.021997 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.022212 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.022309 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.022518 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.022605 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.022825 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.022913 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.023128 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.023268 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.023434 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.023532 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.023740 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.023849 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.024076 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.024163 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.024383 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.024484 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.024691 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.024779 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025003 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025134 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025317 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025420 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025622 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025714 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.025930 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.026022 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.026238 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.026341 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.026569 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.026750 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.026883 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.027060 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.027196 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.027386 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.027510 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.027707 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.028053 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.028164 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.028366 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.028454 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.028680 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.028769 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029003 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029089 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029305 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029399 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029605 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029691 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.029910 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030007 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030215 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030302 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030518 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030656 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030833 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.030929 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.031138 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.031224 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.031438 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.031525 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.031740 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.031851 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.032072 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.032158 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.032384 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.032598 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.032703 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.032941 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.033031 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.033255 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.033342 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.033574 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.033814 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.033906 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.034168 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.034256 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035030 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035136 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035363 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035452 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035665 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035751 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.035993 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.036084 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.036307 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.036397 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.036621 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.036743 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.036923 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037045 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037225 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037385 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037530 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037619 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037836 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.037934 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.038136 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.038225 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.038440 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.038528 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.038738 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.038834 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039049 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039135 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039347 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039441 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039646 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039748 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.039987 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.040076 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.040294 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.040391 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.040601 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.040739 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.040901 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041003 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041202 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041290 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041502 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041598 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041806 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.041893 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.042104 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.042189 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.042406 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.042496 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.042702 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.042788 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043006 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043093 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043305 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043402 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043609 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043697 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.043931 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044023 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044244 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044334 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044550 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044638 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044856 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.044950 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.045165 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.045253 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.045472 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.045561 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.045789 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.045889 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.046093 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.046180 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.046399 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.046493 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.046707 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.046805 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.047031 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.047119 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.047345 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.047561 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.047658 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.047920 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.048010 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.048243 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.048330 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.048578 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.048832 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.048921 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.049167 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.049254 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.049487 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.049574 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.049789 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.049876 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.050136 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.050223 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.050447 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.050537 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.050759 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.050847 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.051065 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.051151 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.051372 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.051468 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.051679 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.051767 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052013 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052102 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052427 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052631 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052718 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.052937 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053032 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053242 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053338 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053546 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053645 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053850 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.053940 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.054157 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.054244 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.054463 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.054550 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.054770 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.054864 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.055081 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.055177 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.055389 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.055485 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.055698 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.055785 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056037 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056128 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056347 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056434 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056653 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056740 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.056958 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.057048 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.057281 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.057370 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.057571 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.057677 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.057882 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058009 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058188 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058278 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058490 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058586 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058802 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.058888 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.059131 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.059229 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.059445 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.059548 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.059750 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.059859 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.060127 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.060214 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.060446 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.060535 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.060767 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.060856 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.061076 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.061174 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.061391 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.061487 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.061696 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.061783 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062018 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062116 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062328 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062417 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062649 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062737 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.062959 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063056 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063258 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063346 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063559 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063647 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063879 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.063984 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.064188 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.064276 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.064501 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.064597 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.064808 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.064904 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.065111 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.065215 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.065412 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.065502 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.065743 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.065840 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066044 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066149 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066342 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066435 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066640 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066734 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.066938 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067026 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067241 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067341 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067539 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067628 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067869 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.067962 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.068152 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.068251 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.068447 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.068535 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.068743 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.068832 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069041 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069137 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069340 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069427 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069637 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069724 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.069936 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070032 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070236 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070322 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070537 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070625 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070836 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.070999 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.071144 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.071230 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.071448 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.071534 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.071752 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.071868 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.072108 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.072195 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.072416 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.072515 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.072735 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.072824 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073038 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073125 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073354 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073441 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073671 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073760 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.073981 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.074075 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.074716 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.074856 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.074856 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075074 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075074 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075267 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075379 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075484 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075597 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075710 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075815 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.075984 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.076115 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.076243 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.076423 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.076538 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.076738 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.076857 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077049 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077177 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077349 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077461 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077666 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077789 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.077968 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.078090 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.078282 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.078396 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.078586 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.078707 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.078890 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079004 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079214 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079328 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079520 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079634 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079842 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.079936 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.080157 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.080246 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.080463 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.080553 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.080775 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.080864 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.081089 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.081185 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.081911 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082044 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082230 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082332 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082546 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082646 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082849 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.082958 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.083169 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.083262 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.083489 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.083583 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.083816 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.083934 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.084152 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.084244 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.084483 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.084576 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.084963 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085075 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085156 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085225 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085408 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085497 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085714 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085803 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.085956 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 16:01:16.086093 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.086659 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.086742 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.087000 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:01:16.087243 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 16:01:16.243497 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Registered counter for database nova_api Jun 29 16:01:16.246076 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Registered counter for database nova_api Jun 29 16:01:16.264046 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.265770 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.270894 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.272208 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.327856 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.context [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1751ca9-4b08-41b0-bc86-296f8d8ee904(cell1) {{(pid=103210) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 16:01:16.328015 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.context [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1751ca9-4b08-41b0-bc86-296f8d8ee904(cell1) {{(pid=103209) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 16:01:16.331730 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:01:16.331875 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:01:16.333421 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:01:16.333517 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:01:16.334207 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:01:16.334312 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:01:16.336176 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:01:16.336284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:01:16.338125 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Registered counter for database nova_cell0 Jun 29 16:01:16.338226 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Registered counter for database nova_cell0 Jun 29 16:01:16.343679 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Registered counter for database nova_cell1 Jun 29 16:01:16.343795 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Registered counter for database nova_cell1 Jun 29 16:01:16.351188 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.352815 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.354008 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.358209 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.358860 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.360748 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.363313 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.508025 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.510700 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Registered counter for database nova_cell0 Jun 29 16:01:16.516640 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Registered counter for database nova_cell0 Jun 29 16:01:16.519449 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.524720 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.525501 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:01:16.529794 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:01:16.861450 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:01:16.868713 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:01:16.869088 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:01:16.875916 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:01:17.211998 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:01:17.216057 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:01:17.217863 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:01:17.221955 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-9ecad797-6a2a-4587-93b9-57385c94e887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:01:17.223143 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac3afd99c0 pid: 103209 (default app) Jun 29 16:01:17.225214 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:01:17.226401 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Jun 29 16:01:17.226827 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Wed Jun 29 16:01:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:01:17.227172 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac3afd99c0 pid: 103210 (default app) Jun 29 16:02:31.552166 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:31.553187 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jun 29 16:02:31.553595 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:31.565801 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:31.566938 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_cell0:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:31.568112 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_cell1:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:31.569149 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:32.005491 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-d1c5712c-ec00-49a4-ad9e-a148ccd36a91 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:32.037379 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-d1c5712c-ec00-49a4-ad9e-a148ccd36a91 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476996 Jun 29 16:02:32.038123 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jun 29 16:02:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:34.101848 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:34.102838 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-adf7b275-db61-4b45-9bdf-0da8db525163 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 29 16:02:34.103220 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:34.165998 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-682c09a7-599d-4c21-8d30-45262b0a6895 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:34.186582 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:02:34.186582 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: warnings.warn(msg) Jun 29 16:02:34.217755 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-682c09a7-599d-4c21-8d30-45262b0a6895 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108550 Jun 29 16:02:34.218366 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:02:34.234178 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=3 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:34.235778 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell1:SELECT=3 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:34.236838 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell0:SELECT=3 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:34.237850 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:34.445892 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-8500bf2b-dbc7-49d6-b38c-d6463df613ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:34.448202 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:02:34.448202 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: warnings.warn(msg) Jun 29 16:02:34.511582 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-8500bf2b-dbc7-49d6-b38c-d6463df613ea admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284025 Jun 29 16:02:34.520667 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jun 29 16:02:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:36.593259 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-682c09a7-599d-4c21-8d30-45262b0a6895 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:36.594273 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-682c09a7-599d-4c21-8d30-45262b0a6895 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 29 16:02:36.594668 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:36.699073 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-208a5a0a-63e5-4183-98a4-6b17a893f314 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:36.716645 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:02:36.716645 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: warnings.warn(msg) Jun 29 16:02:36.740556 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-208a5a0a-63e5-4183-98a4-6b17a893f314 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140101 Jun 29 16:02:36.741122 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:02:36.753198 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-7a7d1569-e639-43db-93e4-e627d14f0866 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:36.755293 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:02:36.755293 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: warnings.warn(msg) Jun 29 16:02:36.785794 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-7a7d1569-e639-43db-93e4-e627d14f0866 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036185 Jun 29 16:02:36.786363 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jun 29 16:02:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:02:38.888945 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-208a5a0a-63e5-4183-98a4-6b17a893f314 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:38.889958 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-208a5a0a-63e5-4183-98a4-6b17a893f314 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 29 16:02:38.890359 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:02:38.948212 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-f6b98173-a3d5-4947-87b8-fd4e49e58baf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "ram": 1024, "id": "d2"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:38.967800 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-f6b98173-a3d5-4947-87b8-fd4e49e58baf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071054 Jun 29 16:02:38.968575 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:02:38.980520 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-955fb69a-a296-404b-af75-640bc8390fff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:39.004909 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-955fb69a-a296-404b-af75-640bc8390fff admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027796 Jun 29 16:02:39.005740 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jun 29 16:02:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:02:41.097743 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-f6b98173-a3d5-4947-87b8-fd4e49e58baf admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:41.099260 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-f6b98173-a3d5-4947-87b8-fd4e49e58baf admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Jun 29 16:02:41.099683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:41.156620 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-875d404c-fca2-4884-a306-98b1a7a4692b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:41.174105 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-875d404c-fca2-4884-a306-98b1a7a4692b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068644 Jun 29 16:02:41.174648 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:02:41.187218 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e3f5a32b-fa4f-4d4d-95b6-60be52163a5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:41.209000 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e3f5a32b-fa4f-4d4d-95b6-60be52163a5b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025497 Jun 29 16:02:41.209543 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jun 29 16:02:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:43.272535 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-875d404c-fca2-4884-a306-98b1a7a4692b admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:43.273543 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-875d404c-fca2-4884-a306-98b1a7a4692b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 29 16:02:43.273940 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:43.332388 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-dea3fc0e-d600-4cdb-b184-9a2b21a60a09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:43.350599 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-dea3fc0e-d600-4cdb-b184-9a2b21a60a09 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070812 Jun 29 16:02:43.351243 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:02:43.362766 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-0f25712d-8e06-4b73-beb9-eaf831ca3130 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:43.386036 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-0f25712d-8e06-4b73-beb9-eaf831ca3130 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026809 Jun 29 16:02:43.386809 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jun 29 16:02:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:45.482809 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-dea3fc0e-d600-4cdb-b184-9a2b21a60a09 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:45.483844 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-dea3fc0e-d600-4cdb-b184-9a2b21a60a09 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 29 16:02:45.484333 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:45.543499 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f6943112-7072-45c9-8e9a-828da8847a30 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:45.566980 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f6943112-7072-45c9-8e9a-828da8847a30 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076018 Jun 29 16:02:45.568138 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jun 29 16:02:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:02:47.660431 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-dea3fc0e-d600-4cdb-b184-9a2b21a60a09 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:47.662086 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-dea3fc0e-d600-4cdb-b184-9a2b21a60a09 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Jun 29 16:02:47.662452 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:02:47.725185 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-1fa7f203-3201-4aa0-87c5-2e746182dfc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:47.748489 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-1fa7f203-3201-4aa0-87c5-2e746182dfc9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079998 Jun 29 16:02:47.749210 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:02:47.761539 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-4fd269cb-b1ba-4ca8-8a4b-9490be929c4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:47.784902 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-4fd269cb-b1ba-4ca8-8a4b-9490be929c4f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027180 Jun 29 16:02:47.785498 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jun 29 16:02:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:49.856134 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-1fa7f203-3201-4aa0-87c5-2e746182dfc9 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:49.857140 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-1fa7f203-3201-4aa0-87c5-2e746182dfc9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 29 16:02:49.857550 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:49.923553 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-8d574afd-62d7-49f1-9d62-44d54536e485 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "id": "2"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:49.941487 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-8d574afd-62d7-49f1-9d62-44d54536e485 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077959 Jun 29 16:02:49.942799 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:02:49.954701 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-79729848-1cb7-4a17-9efa-3e66949b7695 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:49.978020 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-79729848-1cb7-4a17-9efa-3e66949b7695 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026865 Jun 29 16:02:49.978628 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jun 29 16:02:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:52.047454 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-8d574afd-62d7-49f1-9d62-44d54536e485 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:52.048584 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-8d574afd-62d7-49f1-9d62-44d54536e485 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 29 16:02:52.048951 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:52.120298 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f5836e0c-3a9b-469c-81c8-08eab2f2086b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:52.141270 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f5836e0c-3a9b-469c-81c8-08eab2f2086b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086045 Jun 29 16:02:52.141895 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:02:52.156061 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-d5cb7a07-0024-4ea1-8406-e457c122e0dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:52.179348 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-d5cb7a07-0024-4ea1-8406-e457c122e0dd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028517 Jun 29 16:02:52.179982 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jun 29 16:02:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:54.260557 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f5836e0c-3a9b-469c-81c8-08eab2f2086b admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:54.261566 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f5836e0c-3a9b-469c-81c8-08eab2f2086b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 29 16:02:54.261964 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:54.319740 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-44255cbe-8d4a-4bed-a933-cd6b9209fd89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:54.338729 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-44255cbe-8d4a-4bed-a933-cd6b9209fd89 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070814 Jun 29 16:02:54.339303 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:02:54.351854 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-2f4c3494-be69-401f-9698-9f1c7197ded5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:54.374921 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-2f4c3494-be69-401f-9698-9f1c7197ded5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027629 Jun 29 16:02:54.375494 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jun 29 16:02:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:02:56.450547 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-44255cbe-8d4a-4bed-a933-cd6b9209fd89 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:02:56.451561 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-44255cbe-8d4a-4bed-a933-cd6b9209fd89 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 29 16:02:56.452004 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:02:56.511942 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-42182892-8614-432e-be79-da85d298100a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "ram": 16384}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:56.530908 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-42182892-8614-432e-be79-da85d298100a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073238 Jun 29 16:02:56.531854 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jun 29 16:02:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:02:56.543673 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9fc32f5c-4763-4d7b-9987-2ce56163bd1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:02:56.565458 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9fc32f5c-4763-4d7b-9987-2ce56163bd1a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025456 Jun 29 16:02:56.566042 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jun 29 16:02:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:03:21.610079 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-42182892-8614-432e-be79-da85d298100a admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:21.611121 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-42182892-8614-432e-be79-da85d298100a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 29 16:03:21.611514 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:03:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:21.622739 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:03:21.671844 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-cf96d7a2-366e-439a-a131-bfa56e46d5a9 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:21.690884 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-cf96d7a2-366e-439a-a131-bfa56e46d5a9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072915 Jun 29 16:03:21.691423 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jun 29 16:03:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:03:22.600470 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-42182892-8614-432e-be79-da85d298100a admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:22.601484 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-42182892-8614-432e-be79-da85d298100a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 29 16:03:22.601878 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:22.789288 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-53cec5c5-090f-4613-86f0-48c46761b836 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:22.794779 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.wsgi [None req-53cec5c5-090f-4613-86f0-48c46761b836 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-53cec5c5-090f-4613-86f0-48c46761b836 admin admin] Request method failure captured: Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Accept: application/json Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Accept-Encoding: gzip, deflate Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Connection: keep-alive Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Content-Length: 0 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Host: 10.222.0.47 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Openstack-Api-Version: compute 2.90 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Openstack-System-Scope: None Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: User-Agent: python-novaclient Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Auth-Token: gAAAAABivHfK5ekzro9tqViYUykwd0J-Aroe-_YcInG2Bx_YGdZfaM_sH9hf1nNagnycabgEPTiYwgmy8nupHRVgfsvoCCxXuSl4LWkWCNlgQycwfEwV39PaogVP_UZYFCh8mvkKQ8n1IVoHbAoTz_Hpn52qSzgq0tErqksG7Ku6s5-TefAstR0 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Domain-Id: None Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Domain-Name: None Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Identity-Status: Confirmed Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Is-Admin-Project: True Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Domain-Id: default Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Domain-Name: Default Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Name: admin Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Role: reader,admin,member Jun 29 16:03:22.798012 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Roles: reader,admin,member Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0320d17cc99a4a6e8e5f8fed868d1937", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant: admin Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant-Name: admin Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User: admin Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Domain-Id: default Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Domain-Name: Default Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Id: 06ea7f03390747a9846b3824e80fc6cf Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Name: admin Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: method: > Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: exception: Flavor 42 could not be found. Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: action_args: {'id': '42'} Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:03:22.799683 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:22.800642 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.802624 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-53cec5c5-090f-4613-86f0-48c46761b836 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:03:22.803999 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-53cec5c5-090f-4613-86f0-48c46761b836 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062789 Jun 29 16:03:22.803999 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jun 29 16:03:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:22.809481 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-e3fe42b1-ca47-4514-8b88-fb3d22cf69fa admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:22.812481 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:03:22.831380 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-e3fe42b1-ca47-4514-8b88-fb3d22cf69fa admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025401 Jun 29 16:03:22.831963 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jun 29 16:03:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:03:22.841697 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-49ec694a-f3e5-410e-9c52-59267d3c42b5 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:22.863027 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-49ec694a-f3e5-410e-9c52-59267d3c42b5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025141 Jun 29 16:03:22.863551 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jun 29 16:03:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:03:22.873911 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-7d4e5ebe-45ab-477d-b0c6-fe635c03755f admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:22.879544 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.wsgi [None req-7d4e5ebe-45ab-477d-b0c6-fe635c03755f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-7d4e5ebe-45ab-477d-b0c6-fe635c03755f admin admin] Request method failure captured: Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Accept: application/json Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Accept-Encoding: gzip, deflate Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Connection: keep-alive Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Content-Length: 0 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Host: 10.222.0.47 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Openstack-Api-Version: compute 2.90 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Openstack-System-Scope: None Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: User-Agent: python-novaclient Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Auth-Token: gAAAAABivHfK5ekzro9tqViYUykwd0J-Aroe-_YcInG2Bx_YGdZfaM_sH9hf1nNagnycabgEPTiYwgmy8nupHRVgfsvoCCxXuSl4LWkWCNlgQycwfEwV39PaogVP_UZYFCh8mvkKQ8n1IVoHbAoTz_Hpn52qSzgq0tErqksG7Ku6s5-TefAstR0 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Domain-Id: None Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Domain-Name: None Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Identity-Status: Confirmed Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Is-Admin-Project: True Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Domain-Id: default Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Domain-Name: Default Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Name: admin Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Role: reader,admin,member Jun 29 16:03:22.882884 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Roles: reader,admin,member Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0320d17cc99a4a6e8e5f8fed868d1937", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant: admin Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant-Name: admin Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User: admin Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Domain-Id: default Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Domain-Name: Default Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Id: 06ea7f03390747a9846b3824e80fc6cf Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Name: admin Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: method: > Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: exception: Flavor 42 could not be found. Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: action_args: {'id': '42'} Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:03:22.884467 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:22.885669 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:22.886988 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-7d4e5ebe-45ab-477d-b0c6-fe635c03755f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:03:22.888334 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-7d4e5ebe-45ab-477d-b0c6-fe635c03755f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014550 Jun 29 16:03:22.888334 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jun 29 16:03:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 16:03:23.698634 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-49ec694a-f3e5-410e-9c52-59267d3c42b5 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:23.699625 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-49ec694a-f3e5-410e-9c52-59267d3c42b5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 29 16:03:23.700056 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:23.888326 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-78c981aa-4829-41a5-af2f-8711db0ffc52 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:23.893755 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.wsgi [None req-78c981aa-4829-41a5-af2f-8711db0ffc52 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-78c981aa-4829-41a5-af2f-8711db0ffc52 admin admin] Request method failure captured: Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Accept: application/json Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Accept-Encoding: gzip, deflate Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Connection: keep-alive Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Content-Length: 0 Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Host: 10.222.0.47 Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Openstack-Api-Version: compute 2.90 Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Openstack-System-Scope: None Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: User-Agent: python-novaclient Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Auth-Token: gAAAAABivHfLuUcCo37PFWnEzt2UMOak8o8CTQcuSJbUZAN0CjeN2aOuiJ1mH-GLy3EqPfpMTAXvJa9jp7XRYhAJVCBsB-qMjVxDKasmYFR5wD5XfdpbmmwXCoXNeEB3pytmscGS1h1JPAVeRblRXGdYw8RuQiScMoAopPXSSkoAEBCf3Vs234Q Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Domain-Id: None Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Domain-Name: None Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Identity-Status: Confirmed Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Is-Admin-Project: True Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Domain-Id: default Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Domain-Name: Default Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Name: admin Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Role: reader,admin,member Jun 29 16:03:23.895286 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Roles: reader,admin,member Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0320d17cc99a4a6e8e5f8fed868d1937", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant: admin Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant-Name: admin Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User: admin Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Domain-Id: default Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Domain-Name: Default Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Id: 06ea7f03390747a9846b3824e80fc6cf Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Name: admin Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: method: > Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: exception: Flavor 84 could not be found. Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: action_args: {'id': '84'} Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:03:23.896806 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:23.897589 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.898619 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-78c981aa-4829-41a5-af2f-8711db0ffc52 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:03:23.899625 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-78c981aa-4829-41a5-af2f-8711db0ffc52 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060847 Jun 29 16:03:23.899625 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jun 29 16:03:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:23.906298 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-bbadbede-1436-4306-a4c6-d12d88b0eeac admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:23.921370 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-bbadbede-1436-4306-a4c6-d12d88b0eeac admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018578 Jun 29 16:03:23.921832 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jun 29 16:03:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:03:23.931627 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-3a51887b-fc7a-4f51-91a4-a59737a7dc1d admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:23.947530 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-3a51887b-fc7a-4f51-91a4-a59737a7dc1d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019368 Jun 29 16:03:23.948302 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jun 29 16:03:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:03:23.958213 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-d8f4f25b-fb4e-44fb-963d-111f894c7e6a admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:23.963685 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.wsgi [None req-d8f4f25b-fb4e-44fb-963d-111f894c7e6a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-d8f4f25b-fb4e-44fb-963d-111f894c7e6a admin admin] Request method failure captured: Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Accept: application/json Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Accept-Encoding: gzip, deflate Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Connection: keep-alive Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Content-Length: 0 Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Host: 10.222.0.47 Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Openstack-Api-Version: compute 2.90 Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Openstack-System-Scope: None Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: User-Agent: python-novaclient Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Auth-Token: gAAAAABivHfLuUcCo37PFWnEzt2UMOak8o8CTQcuSJbUZAN0CjeN2aOuiJ1mH-GLy3EqPfpMTAXvJa9jp7XRYhAJVCBsB-qMjVxDKasmYFR5wD5XfdpbmmwXCoXNeEB3pytmscGS1h1JPAVeRblRXGdYw8RuQiScMoAopPXSSkoAEBCf3Vs234Q Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Domain-Id: None Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Domain-Name: None Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Identity-Status: Confirmed Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Is-Admin-Project: True Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Domain-Id: default Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Domain-Name: Default Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Name: admin Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Role: reader,admin,member Jun 29 16:03:23.965217 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Roles: reader,admin,member Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0320d17cc99a4a6e8e5f8fed868d1937", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant: admin Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant-Name: admin Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User: admin Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Domain-Id: default Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Domain-Name: Default Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Id: 06ea7f03390747a9846b3824e80fc6cf Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Name: admin Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: method: > Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: exception: Flavor 84 could not be found. Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: action_args: {'id': '84'} Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:03:23.966757 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:23.967579 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:23.968733 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-d8f4f25b-fb4e-44fb-963d-111f894c7e6a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:03:23.969957 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-d8f4f25b-fb4e-44fb-963d-111f894c7e6a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012291 Jun 29 16:03:23.969957 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jun 29 16:03:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:24.774902 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-3a51887b-fc7a-4f51-91a4-a59737a7dc1d admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:24.775990 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-3a51887b-fc7a-4f51-91a4-a59737a7dc1d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 29 16:03:24.776382 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:24.965056 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-28d5ef08-c317-45b8-88fd-67bfc7f2261a admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:24.970796 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.wsgi [None req-28d5ef08-c317-45b8-88fd-67bfc7f2261a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-28d5ef08-c317-45b8-88fd-67bfc7f2261a admin admin] Request method failure captured: Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Accept: application/json Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Accept-Encoding: gzip, deflate Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Connection: keep-alive Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Content-Length: 0 Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Host: 10.222.0.47 Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Openstack-Api-Version: compute 2.90 Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Openstack-System-Scope: None Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: User-Agent: python-novaclient Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Auth-Token: gAAAAABivHfMsTY5UVVEmHe3BHjczN5FDx001xrplVmwqk_tzCyHo657G_wQyGcg-Jn9KwnStnI8iVN5DZlkqiCNI__f8lhYdbbATjrF9Pd6_U7zk__WZiAP2Po4LbKoAASdCGuhCXPqJ-Ck5OhBpLaKCUM6eHsmCTCJFZzHKV_6jDgfaD4X8fY Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Domain-Id: None Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Domain-Name: None Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Identity-Status: Confirmed Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Is-Admin-Project: True Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Domain-Id: default Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Domain-Name: Default Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Project-Name: admin Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Role: reader,admin,member Jun 29 16:03:24.972327 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Roles: reader,admin,member Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0320d17cc99a4a6e8e5f8fed868d1937", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant: admin Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-Tenant-Name: admin Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User: admin Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Domain-Id: default Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Domain-Name: Default Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Id: 06ea7f03390747a9846b3824e80fc6cf Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: X-User-Name: admin Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: method: > Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: exception: Flavor 451 could not be found. Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: action_args: {'id': '451'} Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:03:24.973905 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:24.975284 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Jun 29 16:03:24.976394 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-28d5ef08-c317-45b8-88fd-67bfc7f2261a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:03:24.977393 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-28d5ef08-c317-45b8-88fd-67bfc7f2261a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058857 Jun 29 16:03:24.977393 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jun 29 16:03:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:24.983792 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-c36d40fb-361e-4821-a293-b5bbef71c72a admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:24.998890 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-c36d40fb-361e-4821-a293-b5bbef71c72a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018626 Jun 29 16:03:24.999406 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jun 29 16:03:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:03:25.008987 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:25.022887 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017817 Jun 29 16:03:25.023352 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jun 29 16:03:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:03:25.032256 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-895cd8d3-908c-4a07-9b8c-b5bc021feeeb admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:25.037469 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.wsgi [None req-895cd8d3-908c-4a07-9b8c-b5bc021feeeb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-895cd8d3-908c-4a07-9b8c-b5bc021feeeb admin admin] Request method failure captured: Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Accept: application/json Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Accept-Encoding: gzip, deflate Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Connection: keep-alive Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Content-Length: 0 Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Host: 10.222.0.47 Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Openstack-Api-Version: compute 2.90 Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Openstack-System-Scope: None Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: User-Agent: python-novaclient Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Auth-Token: gAAAAABivHfMsTY5UVVEmHe3BHjczN5FDx001xrplVmwqk_tzCyHo657G_wQyGcg-Jn9KwnStnI8iVN5DZlkqiCNI__f8lhYdbbATjrF9Pd6_U7zk__WZiAP2Po4LbKoAASdCGuhCXPqJ-Ck5OhBpLaKCUM6eHsmCTCJFZzHKV_6jDgfaD4X8fY Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Domain-Id: None Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Domain-Name: None Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Identity-Status: Confirmed Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Is-Admin-Project: True Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Domain-Id: default Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Domain-Name: Default Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Project-Name: admin Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Role: reader,admin,member Jun 29 16:03:25.038944 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Roles: reader,admin,member Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0320d17cc99a4a6e8e5f8fed868d1937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0320d17cc99a4a6e8e5f8fed868d1937", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant: admin Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant-Id: 0320d17cc99a4a6e8e5f8fed868d1937 Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-Tenant-Name: admin Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User: admin Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Domain-Id: default Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Domain-Name: Default Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Id: 06ea7f03390747a9846b3824e80fc6cf Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: X-User-Name: admin Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: method: > Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: exception: Flavor 451 could not be found. Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: action_args: {'id': '451'} Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:03:25.040345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:25.041329 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Jun 29 16:03:25.042682 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-895cd8d3-908c-4a07-9b8c-b5bc021feeeb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:03:25.043940 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-895cd8d3-908c-4a07-9b8c-b5bc021feeeb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011530 Jun 29 16:03:25.043940 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jun 29 16:03:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:25.866259 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:25.867298 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 29 16:03:25.867694 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:26.060362 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-85d80fac-5372-4ef3-a0eb-9f1f7f1e1608 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:03:26.078027 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-85d80fac-5372-4ef3-a0eb-9f1f7f1e1608 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068524 Jun 29 16:03:26.078503 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jun 29 16:03:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:03:26.891447 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:26.892488 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 29 16:03:26.892880 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:27.080686 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-bb15a8f0-229b-4f5a-b1cf-10548a4e8f64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:03:27.098707 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-bb15a8f0-229b-4f5a-b1cf-10548a4e8f64 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068713 Jun 29 16:03:27.099343 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jun 29 16:03:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:03:27.921762 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:27.922777 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 29 16:03:27.923176 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:28.117972 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-dd42552d-674c-4bd7-813f-7f893dfc962d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:03:28.135364 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-dd42552d-674c-4bd7-813f-7f893dfc962d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068214 Jun 29 16:03:28.135868 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jun 29 16:03:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:03:28.942091 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:28.943118 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 29 16:03:28.943510 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:29.130506 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-686eba65-6b11-4b2f-a367-571fcfab0a7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:03:29.147912 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-686eba65-6b11-4b2f-a367-571fcfab0a7e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068398 Jun 29 16:03:29.148449 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jun 29 16:03:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:03:29.969688 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:29.970697 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 29 16:03:29.971089 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:03:30.166665 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b1aa6c8f-9dc6-4f6a-adf6-1840eedf1f28 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:03:30.185837 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-b1aa6c8f-9dc6-4f6a-adf6-1840eedf1f28 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071713 Jun 29 16:03:30.186303 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Wed Jun 29 16:03:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:04:16.500255 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:04:16.501257 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c31085c7-a8cd-4390-aa60-fb704d191784 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 29 16:04:16.501647 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jun 29 16:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:04:16.511994 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:04:16.560624 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-58e8c808-6470-47de-bd24-b7ffc34e0f75 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:04:16.579252 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-58e8c808-6470-47de-bd24-b7ffc34e0f75 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071723 Jun 29 16:04:16.579783 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jun 29 16:04:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:04:16.602402 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e6f97201-36d8-4cb9-8b37-a42183197cb8 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:04:16.605820 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=14 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:04:16.611101 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e6f97201-36d8-4cb9-8b37-a42183197cb8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012258 Jun 29 16:04:16.612312 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Jun 29 16:04:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:04:16.623597 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f62a17d8-9154-472b-b1db-7df16f5a6203 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:04:16.631334 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f62a17d8-9154-472b-b1db-7df16f5a6203 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011282 Jun 29 16:04:16.631865 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Jun 29 16:04:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:04:16.642679 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:04:16.649887 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010823 Jun 29 16:04:16.650396 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Jun 29 16:04:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:04:16.661313 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-e33b71e9-c921-4bf3-b86b-43d01aeaf633 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:04:16.668486 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-e33b71e9-c921-4bf3-b86b-43d01aeaf633 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010981 Jun 29 16:04:16.668990 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Jun 29 16:04:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:07:43.022698 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:43.023717 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 29 16:07:43.024141 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:07:43.164380 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=6 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:07:43.276866 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-9ae56801-2140-454c-8f56-2b0e155a7365 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:43.278025 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:07:43.278025 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: warnings.warn(msg) Jun 29 16:07:43.279746 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-9ae56801-2140-454c-8f56-2b0e155a7365 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:43.280220 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-9ae56801-2140-454c-8f56-2b0e155a7365 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:43.281027 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-9ae56801-2140-454c-8f56-2b0e155a7365 admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:43.281453 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-9ae56801-2140-454c-8f56-2b0e155a7365 admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:43.315187 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-9ae56801-2140-454c-8f56-2b0e155a7365 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152371 Jun 29 16:07:43.315745 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jun 29 16:07:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:07:44.143879 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:44.144890 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 29 16:07:44.145287 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:07:44.335727 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-49fb09cd-e350-458d-a1b8-c9d201775b80 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:44.336915 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:07:44.336915 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: warnings.warn(msg) Jun 29 16:07:44.338127 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-49fb09cd-e350-458d-a1b8-c9d201775b80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:44.338518 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-49fb09cd-e350-458d-a1b8-c9d201775b80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:44.339308 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-49fb09cd-e350-458d-a1b8-c9d201775b80 admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:44.339724 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-49fb09cd-e350-458d-a1b8-c9d201775b80 admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:44.359573 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-49fb09cd-e350-458d-a1b8-c9d201775b80 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074307 Jun 29 16:07:44.360208 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jun 29 16:07:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:07:55.599360 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:55.600391 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 29 16:07:55.600790 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:07:55.741934 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell0:SELECT=4 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:07:55.742684 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell1:SELECT=4 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:07:55.743552 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=8 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:07:55.791429 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-ba836f7d-4306-48ad-8bc9-026868a26e7e admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:55.792618 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:07:55.792618 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: warnings.warn(msg) Jun 29 16:07:55.793815 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-ba836f7d-4306-48ad-8bc9-026868a26e7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:55.794255 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-ba836f7d-4306-48ad-8bc9-026868a26e7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:55.795581 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-ba836f7d-4306-48ad-8bc9-026868a26e7e admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:55.796042 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-ba836f7d-4306-48ad-8bc9-026868a26e7e admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:55.820345 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-ba836f7d-4306-48ad-8bc9-026868a26e7e admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082737 Jun 29 16:07:55.820823 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jun 29 16:07:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:07:56.645981 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:56.646984 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3448a750-e6fb-41ac-8f3b-54bc8347eb21 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 29 16:07:56.647377 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jun 29 16:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:07:56.835613 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-e6a795f8-0c4f-4d0f-84b5-a4f671cfa05f admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:07:56.836794 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:07:56.836794 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: warnings.warn(msg) Jun 29 16:07:56.837975 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-e6a795f8-0c4f-4d0f-84b5-a4f671cfa05f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:56.838414 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-e6a795f8-0c4f-4d0f-84b5-a4f671cfa05f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:56.839201 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-e6a795f8-0c4f-4d0f-84b5-a4f671cfa05f admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:07:56.839665 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-e6a795f8-0c4f-4d0f-84b5-a4f671cfa05f admin admin] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:07:56.861705 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-e6a795f8-0c4f-4d0f-84b5-a4f671cfa05f admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076921 Jun 29 16:07:56.862191 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jun 29 16:07:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:08:53.281179 dv-cinder-848147-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 29 16:08:53.281878 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: Wed Jun 29 16:08:53 2022 - graceful shutdown triggered... Jun 29 16:08:53.282335 dv-cinder-848147-1-iscsi devstack@n-api.service[103210]: Gracefully killing worker 2 (pid: 103210)... Jun 29 16:08:53.282695 dv-cinder-848147-1-iscsi devstack@n-api.service[103209]: Gracefully killing worker 1 (pid: 103209)... Jun 29 16:08:54.282637 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: worker 1 buried after 1 seconds Jun 29 16:08:54.283097 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: worker 2 buried after 1 seconds Jun 29 16:08:54.283097 dv-cinder-848147-1-iscsi devstack@n-api.service[103208]: goodbye to uWSGI. Jun 29 16:08:54.284234 dv-cinder-848147-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 29 16:08:54.284780 dv-cinder-848147-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 29 16:08:54.287647 dv-cinder-848147-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 16:08:54.299841 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 16:08:54 2022] *** Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: nodename: dv-cinder-848147-1-iscsi Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: machine: x86_64 Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: clock source: unix Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: pcre jit disabled Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: detected number of CPU cores: 4 Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: current working directory: / Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: detected binary path: /usr/bin/uwsgi-core Jun 29 16:08:54.301825 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: your processes number limit is 47680 Jun 29 16:08:54.302711 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: your memory page size is 4096 bytes Jun 29 16:08:54.302711 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: detected max file descriptor number: 2048 Jun 29 16:08:54.302711 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: lock engine: pthread robust mutexes Jun 29 16:08:54.302711 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: thunder lock: enabled Jun 29 16:08:54.302711 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 16:08:54.302711 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 16:08:54.347146 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: Python main interpreter initialized at 0x55f79ac479c0 Jun 29 16:08:54.347146 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: python threads support enabled Jun 29 16:08:54.347146 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: your server socket listen backlog is limited to 100 connections Jun 29 16:08:54.347146 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: your mercy for graceful operations on workers is 90 seconds Jun 29 16:08:54.347513 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 16:08:54.347513 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: *** Operational MODE: preforking *** Jun 29 16:08:54.347768 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: *** uWSGI is running in multiple interpreter mode *** Jun 29 16:08:54.347768 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: spawned uWSGI master process (pid: 117716) Jun 29 16:08:54.347978 dv-cinder-848147-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 16:08:54.348842 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: spawned uWSGI worker 1 (pid: 117727, cores: 1) Jun 29 16:08:54.348962 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: spawned uWSGI worker 2 (pid: 117728, cores: 1) Jun 29 16:08:54.351854 dv-cinder-848147-1-iscsi devstack@n-api.service[117716]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 16:08:55.022030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 16:08:55.022766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 16:08:56.225838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:08:56.225838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: from cryptography.utils import int_from_bytes Jun 29 16:08:56.226469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:08:56.226469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: from cryptography.utils import int_from_bytes Jun 29 16:08:56.231600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:08:56.231600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: from cryptography.utils import int_from_bytes Jun 29 16:08:56.232092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 16:08:56.232092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: from cryptography.utils import int_from_bytes Jun 29 16:08:58.604971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 16:08:58.605855 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 16:08:58.606410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 16:08:58.606947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 16:08:58.607126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 16:08:58.607420 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.607757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.608162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.608456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.608797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.609113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.609438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.610308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.610645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.610908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.611227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.611557 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848147-1-iscsi {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.611909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.612221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.612539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.612867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.613175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.613502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.613813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.614325 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.615064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.615379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.620342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848147-1-iscsi {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.622005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.624010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.625159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.625924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 16:08:58.626397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.626559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 16:08:58.626711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.626872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 16:08:58.627024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.627024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.627466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 16:08:58.627629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.627783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 16:08:58.627967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.628121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.628273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.628415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.628564 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.628709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.628867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629333 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.629939 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630237 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.630993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631142 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631453 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848147-1-iscsi {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631752 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.631937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.632259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.632259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.632534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.632534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.632815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.632815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.633362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.633520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.633691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.633929 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634672 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.634962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.635112 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.635274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.635424 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.635566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.635707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.635872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.636038 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.636191 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.636344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.636492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.636645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.636793 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.637018 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.637184 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.637487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.637643 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.637786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.637937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848147-1-iscsi {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.638938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.639079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.639237 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.639386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.639542 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.639691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.639879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640040 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640491 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.640935 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.641974 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.642137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.642279 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.642428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.642570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.642720 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.642869 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.643047 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.643341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.643563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.643718 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.643890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.644140 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.644303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.644445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.644586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.644736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.644884 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645028 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.645973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646114 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646266 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646422 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.646997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.647147 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.647301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.647597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.647745 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.647906 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648063 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.648949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.649110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.649262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.649410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.649558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.649707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.649854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650447 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650588 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650728 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.650882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.651170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.651170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.651438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.651585 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.651736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.651920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.652069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.652069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.652489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.652489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.652785 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.652926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.653089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.653089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.653486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.653727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.653885 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.654027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.654274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.654274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.654564 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.654716 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.654857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.655005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.655154 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.655314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.655464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.655626 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.655778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.655949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.656102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.656254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.656406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.657061 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.657229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.657402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.657701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.657869 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.658026 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.658176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.658330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.658473 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.658614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.658755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.658909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.659059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.659209 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.659356 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.659499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.659650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.659811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.659986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.660128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.660277 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.660429 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.660584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.660726 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.660874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.661016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.661164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.661501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.661677 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.661822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.661981 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.662132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.662282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.662445 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.662680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.662834 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.662975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.663116 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.663267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.663427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.663642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.663642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.664060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.664213 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.664454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.664454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.664741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.664890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.665042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.665184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.665332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.665473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.665620 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.665769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.666007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.666170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.666321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.666476 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.666622 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.666771 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.666921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.667070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.667219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.667360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.667501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.667648 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.667979 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.668134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.668287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.668428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.668568 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.668730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.668891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.668891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.669214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.669370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.669520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.669662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.669809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.669965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.670107 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.670265 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.670416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.670558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.670706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.670847 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.670987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.671129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.671277 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.671419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.671573 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.671722 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.671880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.672038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 16:08:58.672271 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.673007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.673171 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.673315 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.673462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.673462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.673827 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.674065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.674227 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.674450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.674676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.674823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.674985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.675138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.675286 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.675428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.675569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.675710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.675879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676339 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676801 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.676963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.677121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.677272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.677414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.677561 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.677703 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.677869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.678147 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.678303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.678454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.678596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.678746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.678906 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.679049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.679196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.679346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.679495 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.679646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.679795 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680143 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680303 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680616 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.680920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681355 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681507 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.681945 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682392 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.682997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.683227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.683382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.683532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.683684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.683853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.684083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.684322 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.684476 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.684621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.684866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685780 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.685929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.686086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.686229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.686376 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.686524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.686670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.687433 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.687588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.687772 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.687995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.688318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.688476 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.688628 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.688771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.688923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.689066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.689207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.689348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.689498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.689829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.689973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.690125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.690426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.690722 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.690867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691320 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.691934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.692096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.692245 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.692394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.692548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.692698 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.692848 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.693002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.693160 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.693399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.693545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.693686 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.693904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.694075 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.694318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.694544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.694699 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.694858 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.695097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.695245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.695386 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.695546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.695689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.695900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.696956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.697103 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.697246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.697387 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.697545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.697700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.697849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.698001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.698143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.698450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.698607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.698760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.698909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699799 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.699973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.700133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.700275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.700426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.700580 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.700731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.700879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701163 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701470 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.701901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.702911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.703067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.703216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.703413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.703638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.703798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.703998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.704165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.704338 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.704579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.704829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.705243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.705411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.705569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.705725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.705873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.706031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.706186 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.706418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.706590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.706741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.706888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.707043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.707198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.707360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.707516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.707674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.707845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.708027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.708184 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.708341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.708650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.708805 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.708952 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.709107 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.709264 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.709413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.709572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.709721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.709877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710804 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.710950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.711107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.711255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.711401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.711547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.711701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.711869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712035 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712652 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.712957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.713105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.713259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.713414 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.713562 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.713803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.713959 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.714106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.714263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.714410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.714575 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.714827 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.715050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.715227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.715462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.715614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.715771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.715983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.716142 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.716291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.716436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.716610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.716759 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.716920 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717697 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.717991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.718154 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.718313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.718461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.718791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.718947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.719617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.719767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.719943 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.720093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.720257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.720407 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.720567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.720715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.720863 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721181 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721181 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721775 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.721935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722082 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722229 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722531 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722677 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.722993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.723159 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.723307 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.723455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.723602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.723780 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.724014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.724179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.724416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.724567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.724723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.724964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.725200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.725354 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.725632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.725789 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.725945 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.726094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.726249 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.726397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.726555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.726704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.726852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.727006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.727165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.727322 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.727488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.727657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.727805 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.728022 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.728172 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.728333 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.728488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.728644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.728938 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.729102 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.729274 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.729441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.729597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.729758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.729913 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730062 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.730998 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.731155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.731313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.731462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.731620 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.731779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.731964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.732122 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.732272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.732419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.732567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.732721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.732880 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733037 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733193 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733810 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.733992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.734213 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.734365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.734521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.734734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.735547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.735807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736026 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736186 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.736970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.737129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.737285 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.737441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.737603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.737752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.737899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.738054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.738203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.738351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.738512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.738672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.738821 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.739129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.739294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.739461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.739461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.739746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.739926 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.740078 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.740228 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.740389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.740538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.740693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.740853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741009 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741167 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.741945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.742094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.742256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.742412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.742574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.742730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.742896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.743044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.743200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.743349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.743497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.743653 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.744064 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.744234 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.744450 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.744614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.744763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.744927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.745076 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.745242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.745400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.745689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.745947 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.746103 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.746253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.746403 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.746559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.746715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.746873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747496 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747644 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.747993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.748153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.748302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.748449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.748604 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.748806 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.748965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.749270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.749427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.749589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.749747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.749896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.750043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.750198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.750382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.750540 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.750698 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.750854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751624 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.751949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.752110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.752267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.752424 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.752582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.752740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.752897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753047 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753590 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.753992 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.754999 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.755125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.755251 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.755377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.755503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.755870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756378 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756643 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.756907 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757172 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757447 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757575 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.757963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758096 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758489 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.758882 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.759023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.759157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.759432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.759560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.759694 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.759863 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760007 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760137 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760264 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760515 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760791 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.760926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.761061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.761189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.761337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.761630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.761776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.761904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762020 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762020 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762821 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.762956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.763214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.763342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.763342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.763596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.763736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.763736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764286 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.764877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.765134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.765269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.765269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.765539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.765667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.765963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.766970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.767236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.767372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.767514 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.767642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.767642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.767946 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.768854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.769220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.769496 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.769496 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.769764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.769900 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770035 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.770940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.771987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.772977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773616 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.773989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774124 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.774899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775161 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775797 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.775797 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.776242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.776460 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.776460 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.776713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.776843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.776843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777092 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777612 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777612 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.777986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778511 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.778893 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779847 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779847 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.779847 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.780987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.781243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.781383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.782069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.782285 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.782425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.782657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.782796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.783052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.783202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.783331 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.783603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.783743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.783962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.784132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.784271 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.784588 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.784727 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.784951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.785219 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.785365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.785537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.785733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.785876 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.786147 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.786290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.786527 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.786669 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.786805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.787100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.787231 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.787522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.787661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.787870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.788051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.788193 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.788500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.788636 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.788828 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.788991 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.789130 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.789434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.789704 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.789839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.789965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.790090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.790343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.790474 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.790672 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.790857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.790987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.791287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.791425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.791603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.791881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.792056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.792237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.792378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.792549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.792876 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.793014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.793237 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.793384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.793513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.793810 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.793949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.794133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.794319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.794451 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.794756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.794895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.795108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.795274 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.795415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.795692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.795980 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.796260 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.796397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.796524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.796742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.796882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.797020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.797205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.797828 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.798113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.798246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.798451 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.798591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.798766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.799025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.799157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.799420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.799559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.799855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.800050 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.800183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.800414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.800556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.800725 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.801015 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.801156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.801344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.801528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.801668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.801949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.802089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.802259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.802482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.802617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.802868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.803670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.803806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804136 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804264 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.804790 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.805019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.805181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.805424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.805567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.805734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.805923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.806063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.806351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.806581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.806731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.806965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.807096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.807224 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.807404 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.807543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.807858 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.808008 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.808184 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.808389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.808528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.808824 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.808953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.809146 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.809309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.809448 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.809784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.810056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.810188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.810325 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.810455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.810691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.810822 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.811005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.811184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.811330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812118 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812519 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.812944 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.813181 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.813319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.813502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.813662 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.813886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.814126 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.814255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.814442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.814760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.815077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.815445 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.815596 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.815726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.815881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.816240 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.816552 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.816698 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.816698 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.816956 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.817171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.817542 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.817679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.817808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.817935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.817935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.818227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.818365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.818513 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.818669 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.818831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.818969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.819154 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.819287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.819490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.819630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.819844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.819994 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.820295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.820428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.820557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.820684 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.820810 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.820939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.821075 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.821204 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.821380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.821671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.821805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.821995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.822128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.822311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.822444 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.822627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.822760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.822957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.823089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.823293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.823426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.823619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.823759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824193 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.824897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.825087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.825220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.825407 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.825562 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.825764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.825904 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.826063 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.826197 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.826391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.826545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.826816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.826947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827697 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.827997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.828126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.828287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.828753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.828937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.829072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.829389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.829521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.829708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.829951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.830091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.830376 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.830517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.830647 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.830997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.831262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.831585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.831718 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.832021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.832168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.832362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.832693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.832832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.833020 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.833272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.833403 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.833727 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.833861 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.834057 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.834295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.834633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.834742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.835000 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.835202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.835340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.835796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.835961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.836105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.836364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.836669 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.836949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.837114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.837253 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.837443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.837776 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.837879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.838105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.838350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.838623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.838737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.839056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.839199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.839393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.839752 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.840176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.840503 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.840859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.841996 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.842329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.842652 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.842972 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.843325 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.843601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.845415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.845949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.846451 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.846624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.846782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.847019 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.847169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.847369 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.847502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.847751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.847904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.848113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.848243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.848455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.848586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.848773 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.848899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.849095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.849230 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.849426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.849569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.849752 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.849908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.850151 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.850286 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.850478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.850734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.850852 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.851101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.851206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.851445 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.851558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.851787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.852042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.852148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.852385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.852488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.852714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.852818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.853059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.853160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.853400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.853501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.853714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.853808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.854993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.855095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.855311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.855473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.855631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.855725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.855987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.856086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.856309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.856417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.856627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.856729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.856945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857579 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857671 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.857998 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.858214 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.858319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.858526 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.858627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.858844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.858946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.859157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.859259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.859472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.859566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.860373 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.860474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.860680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.860765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.861949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862577 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.862992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.863235 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.863347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.863546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.863640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.863874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.864413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.864519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.864731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.864826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.865054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.865148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.865379 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.865472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.865694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.865796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.866021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.866160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.866348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.866453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.866664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.866987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.867090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.867303 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.867399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.867639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.867734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.868007 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.868150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.868342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.868434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.868658 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869225 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869324 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869842 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.869935 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.870158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.870253 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.870478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.870580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.870789 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.870881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.871096 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.871191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.871401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.871509 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.871722 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.871814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872483 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872682 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.872991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.873120 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.873304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.873434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.873609 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.873739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874513 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874789 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.874975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875204 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875527 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.875877 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876033 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876652 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.876940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.877152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.877252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.877549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.877656 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.877889 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.877993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.878213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.878307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.878526 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.878634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.878851 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.879055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.879156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.879377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.879471 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.879706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.879801 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.880075 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.880197 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.880395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.880499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.880750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.881067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.881166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.881385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.881490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.881708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.881811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882024 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.882991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.883092 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.883323 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.883427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.883633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.883770 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.883989 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.884096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.884310 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.884421 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.884635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.884736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.884953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885373 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885582 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.885990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.886204 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.886378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.886522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.886614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.886831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.886932 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.887142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.887244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.887453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.887550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.887762 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.887951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.888104 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.888199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.888413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.888515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.888721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.888823 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889338 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889749 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.889955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.890051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.890270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.890371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.890577 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.890680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.890912 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.891017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.891223 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.891318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.891540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.891651 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.891808 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 16:08:58.891921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.892202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.892544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.892869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.893202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.893521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.893850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.894170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.894498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.894826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.895145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.895464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.895805 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.896152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.896473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.896792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.897110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.897427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.897746 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.898080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.898415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.898729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.899062 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.899385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.899745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.900096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.900415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.900752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.901069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.901389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.901712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.902027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.902343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.902666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.902989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.903324 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.903655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.903995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.904330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.904663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.905042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.905364 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.905714 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.906050 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.906370 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.907213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.907524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 16:08:58.907768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 16:08:58.955579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Registered counter for database nova_api Jun 29 16:08:58.972308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO dbcounter [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Registered counter for database nova_api Jun 29 16:08:58.976217 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:58.982704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:58.992795 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_db.sqlalchemy.engines [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:58.999574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writer thread running {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.040599 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.context [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1751ca9-4b08-41b0-bc86-296f8d8ee904(cell1) {{(pid=117727) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 16:08:59.044708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:08:59.046307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:08:59.047147 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:08:59.049133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:08:59.051149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Registered counter for database nova_cell0 Jun 29 16:08:59.055148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Registered counter for database nova_cell1 Jun 29 16:08:59.056478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.context [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1751ca9-4b08-41b0-bc86-296f8d8ee904(cell1) {{(pid=117728) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 16:08:59.060594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:08:59.062226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:08:59.063105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:08:59.063238 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:59.064360 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:59.065138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:08:59.067177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO dbcounter [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Registered counter for database nova_cell0 Jun 29 16:08:59.070933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.071227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO dbcounter [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Registered counter for database nova_cell1 Jun 29 16:08:59.073168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.079353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_db.sqlalchemy.engines [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:59.082263 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_db.sqlalchemy.engines [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:59.091735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writer thread running {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.093304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writer thread running {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.228769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Registered counter for database nova_cell0 Jun 29 16:08:59.235451 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:59.239873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.243682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO dbcounter [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Registered counter for database nova_cell0 Jun 29 16:08:59.252384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_db.sqlalchemy.engines [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 16:08:59.257095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writer thread running {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 16:08:59.569628 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:08:59.577000 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:08:59.579038 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: WARNING keystonemiddleware.auth_token [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:08:59.586316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: WARNING keystonemiddleware.auth_token [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:08:59.923930 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:08:59.928914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: WARNING keystonemiddleware.auth_token [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 16:08:59.929882 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-1b03d6bc-ff0c-46db-9f64-54c68601fed3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:08:59.934900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: WARNING keystonemiddleware.auth_token [None req-3d2e464c-e153-4003-99aa-d070a956ff4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 16:08:59.935485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f79ac479c0 pid: 117727 (default app) Jun 29 16:08:59.940310 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f79ac479c0 pid: 117728 (default app) Jun 29 16:09:41.352361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.354105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.355613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.356645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:42.759344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce996fa2-bc28-4e2f-80b9-da19650d37db tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Action: 'create', calling method: .version_select at 0x7f0436d603a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-675389588", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce996fa2-bc28-4e2f-80b9-da19650d37db tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Request method failure captured: Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 121 Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlFoKpe6I0-3OsAQ3RJoFvQqck6w5g5obDe1nctsK5jfnhX5ffffIsuSFiO-ds2ApbCr6XB7AETnRzf7Lnv16Tw8hziiixfiOX13mxOLXNDihr1vC9QSu2-ezrBSRzViuEOiOYv2mVpCXrRlywc1KCYCvznhylsA1t4wWmpwIHKvJc Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:09:42.798361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2c817ebe7ac040be9c2f0a63d8a86dfa", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 2e88276aba204eeb8af05590f7904d5d Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-675389588", "metadata": {"Type": "work"}}} Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: Jun 29 16:09:42.800088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-675389588', 'metadata': {'Type': 'work'}}}} Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise error Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi '#$%' Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:09:42.801070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 16:09:42.802437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 16:09:42.803658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 16:09:42.803658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:42.803658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce996fa2-bc28-4e2f-80b9-da19650d37db tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:09:42.803658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ce996fa2-bc28-4e2f-80b9-da19650d37db tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.469960 Jun 29 16:09:42.803658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Jun 29 16:09:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1472 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:09:43.327880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-335ffd4e-a7ac-4814-acc1-af04aa730985 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Action: 'create', calling method: .version_select at 0x7f0436d96dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1057997298", "metadata": {"Type": "work"}}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-335ffd4e-a7ac-4814-acc1-af04aa730985 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Request method failure captured: Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 120 Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlFoKpe6I0-3OsAQ3RJoFvQqck6w5g5obDe1nctsK5jfnhX5ffffIsuSFiO-ds2ApbCr6XB7AETnRzf7Lnv16Tw8hziiixfiOX13mxOLXNDihr1vC9QSu2-ezrBSRzViuEOiOYv2mVpCXrRlywc1KCYCvznhylsA1t4wWmpwIHKvJc Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:09:43.340496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2c817ebe7ac040be9c2f0a63d8a86dfa", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2e88276aba204eeb8af05590f7904d5d Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1057997298", "metadata": {"Type": "work"}}} Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: Jun 29 16:09:43.341833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1057997298', 'metadata': {'Type': 'work'}}}} Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise error Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi '0' Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:09:43.342613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 16:09:43.343988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 16:09:43.345072 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 16:09:43.345072 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.350673 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-335ffd4e-a7ac-4814-acc1-af04aa730985 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:09:43.354630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-335ffd4e-a7ac-4814-acc1-af04aa730985 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.544087 Jun 29 16:09:43.359973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Jun 29 16:09:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 553 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:09:43.366571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e200ef9-a6e0-4685-b88f-f0a8e18184a7 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Action: 'create', calling method: .version_select at 0x7f0436d0b700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1572503268", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e200ef9-a6e0-4685-b88f-f0a8e18184a7 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Request method failure captured: Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 119 Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlFoKpe6I0-3OsAQ3RJoFvQqck6w5g5obDe1nctsK5jfnhX5ffffIsuSFiO-ds2ApbCr6XB7AETnRzf7Lnv16Tw8hziiixfiOX13mxOLXNDihr1vC9QSu2-ezrBSRzViuEOiOYv2mVpCXrRlywc1KCYCvznhylsA1t4wWmpwIHKvJc Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:09:43.370401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2c817ebe7ac040be9c2f0a63d8a86dfa", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 2e88276aba204eeb8af05590f7904d5d Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1572503268", "metadata": {"Type": "work"}}} Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: Jun 29 16:09:43.372058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1572503268', 'metadata': {'Type': 'work'}}}} Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise error Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi '' Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:09:43.373174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 16:09:43.375578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 16:09:43.378430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 16:09:43.378430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:43.390648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e200ef9-a6e0-4685-b88f-f0a8e18184a7 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:09:43.402232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9e200ef9-a6e0-4685-b88f-f0a8e18184a7 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034574 Jun 29 16:09:43.404414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Jun 29 16:09:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:09:43.496880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d719c2e2-33b6-4b00-a286-2002b5313386 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Calling method '.version_select at 0x7f0436cc7160>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:43.604382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:43.614574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:43.615638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:43.618367 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:44.092890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-d719c2e2-33b6-4b00-a286-2002b5313386 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] HTTP exception thrown: Volume tempest-invalid-1844144916 could not be found. Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d719c2e2-33b6-4b00-a286-2002b5313386 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Request method failure captured: Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1844144916 HTTP/1.1 Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlFoKpe6I0-3OsAQ3RJoFvQqck6w5g5obDe1nctsK5jfnhX5ffffIsuSFiO-ds2ApbCr6XB7AETnRzf7Lnv16Tw8hziiixfiOX13mxOLXNDihr1vC9QSu2-ezrBSRzViuEOiOYv2mVpCXrRlywc1KCYCvznhylsA1t4wWmpwIHKvJc Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:09:44.098348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2c817ebe7ac040be9c2f0a63d8a86dfa", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2e88276aba204eeb8af05590f7904d5d Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Volume tempest-invalid-1844144916 could not be found. Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': 'tempest-invalid-1844144916'} Jun 29 16:09:44.099773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1844144916 could not be found. (HTTP 404) (Request-ID: req-4659215d-8747-4cc4-ab5b-c61365e437f2) Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.100586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 16:09:44.101808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1844144916 could not be found. Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:09:44.103006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1844144916 could not be found. Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1844144916 could not be found. Jun 29 16:09:44.104401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.106468 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d719c2e2-33b6-4b00-a286-2002b5313386 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Returning 404 to user: Volume tempest-invalid-1844144916 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:09:44.108725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d719c2e2-33b6-4b00-a286-2002b5313386 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1844144916" status: 404 len: 99 microversion: 2.1 time: 0.698249 Jun 29 16:09:44.110304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1217 bytes} [Wed Jun 29 16:09:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1844144916 => generated 99 bytes in 701 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 29 16:09:44.119425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-59a47609-96fb-4241-86a6-7f6d47321c95 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003808 Jun 29 16:09:44.120260 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1139 bytes} [Wed Jun 29 16:09:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 16:09:44.130662 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b957c796-5bf7-4558-ab06-25c793c82f1d tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004438 Jun 29 16:09:44.131159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1136 bytes} [Wed Jun 29 16:09:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 16:09:44.142967 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b261e03c-1e26-417f-91c6-3d748f468fa4 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Calling method '.version_select at 0x7f0436d60550>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:44.457302 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-b261e03c-1e26-417f-91c6-3d748f468fa4 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] HTTP exception thrown: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b261e03c-1e26-417f-91c6-3d748f468fa4 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Request method failure captured: Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/os-volumes/0efe278c-c76f-4b33-9392-88af9ec66b6d HTTP/1.1 Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlFoKpe6I0-3OsAQ3RJoFvQqck6w5g5obDe1nctsK5jfnhX5ffffIsuSFiO-ds2ApbCr6XB7AETnRzf7Lnv16Tw8hziiixfiOX13mxOLXNDihr1vC9QSu2-ezrBSRzViuEOiOYv2mVpCXrRlywc1KCYCvznhylsA1t4wWmpwIHKvJc Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:09:44.461680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2c817ebe7ac040be9c2f0a63d8a86dfa", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 2e88276aba204eeb8af05590f7904d5d Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '0efe278c-c76f-4b33-9392-88af9ec66b6d'} Jun 29 16:09:44.463397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. (HTTP 404) (Request-ID: req-9d8705d2-3ed5-4395-a087-e5c58f529c7d) Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.464615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 16:09:44.466239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 16:09:44.467891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b261e03c-1e26-417f-91c6-3d748f468fa4 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Returning 404 to user: Volume 0efe278c-c76f-4b33-9392-88af9ec66b6d could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:09:44.470638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b261e03c-1e26-417f-91c6-3d748f468fa4 tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/0efe278c-c76f-4b33-9392-88af9ec66b6d" status: 404 len: 109 microversion: 2.1 time: 0.326493 Jun 29 16:09:44.472206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:09:44 2022] DELETE /compute/v2.1/os-volumes/0efe278c-c76f-4b33-9392-88af9ec66b6d => generated 109 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:09:44.475217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cd0c3eaa-8f51-447c-94eb-4dba56516bfe tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Calling method '.version_select at 0x7f0436b989d0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:44.517888 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-cd0c3eaa-8f51-447c-94eb-4dba56516bfe tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] HTTP exception thrown: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cd0c3eaa-8f51-447c-94eb-4dba56516bfe tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Request method failure captured: Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/os-volumes/ee4ff31a-4b91-42c0-8452-408c672923d2 HTTP/1.1 Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlFoKpe6I0-3OsAQ3RJoFvQqck6w5g5obDe1nctsK5jfnhX5ffffIsuSFiO-ds2ApbCr6XB7AETnRzf7Lnv16Tw8hziiixfiOX13mxOLXNDihr1vC9QSu2-ezrBSRzViuEOiOYv2mVpCXrRlywc1KCYCvznhylsA1t4wWmpwIHKvJc Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:09:44.520296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2c817ebe7ac040be9c2f0a63d8a86dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2c817ebe7ac040be9c2f0a63d8a86dfa", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 2c817ebe7ac040be9c2f0a63d8a86dfa Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesNegativeTest-541751603 Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2e88276aba204eeb8af05590f7904d5d Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesNegativeTest-541751603-project Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': 'ee4ff31a-4b91-42c0-8452-408c672923d2'} Jun 29 16:09:44.522129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. (HTTP 404) (Request-ID: req-5f01619c-9a60-42d8-a515-0cff3c59d9dd) Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.533293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:09:44.534681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 16:09:44.536646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cd0c3eaa-8f51-447c-94eb-4dba56516bfe tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] Returning 404 to user: Volume ee4ff31a-4b91-42c0-8452-408c672923d2 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cd0c3eaa-8f51-447c-94eb-4dba56516bfe tempest-VolumesNegativeTest-541751603 tempest-VolumesNegativeTest-541751603-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ee4ff31a-4b91-42c0-8452-408c672923d2" status: 404 len: 109 microversion: 2.1 time: 0.050467 Jun 29 16:09:44.538332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:09:44 2022] GET /compute/v2.1/os-volumes/ee4ff31a-4b91-42c0-8452-408c672923d2 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:09:45.592821 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bec6c267-3d07-4818-816f-e811557b65e9 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436e8ce50>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:45.694748 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bec6c267-3d07-4818-816f-e811557b65e9 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02b68079-4410-455d-8736-d33a2acfe71b" status: 200 len: 350 microversion: 2.1 time: 0.111654 Jun 29 16:09:45.695769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 5/9] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:09:45 2022] GET /compute/v2.1/os-volumes/02b68079-4410-455d-8736-d33a2acfe71b => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:47.725635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ad439762-9106-46f2-9933-eea708dd2419 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bb7700>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:47.850834 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ad439762-9106-46f2-9933-eea708dd2419 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a881902c-5844-4a82-991d-447fb73ced9b" status: 200 len: 351 microversion: 2.1 time: 0.129220 Jun 29 16:09:47.851606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 5/10] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:09:47 2022] GET /compute/v2.1/os-volumes/a881902c-5844-4a82-991d-447fb73ced9b => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:49.949703 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-daf703da-3d80-4f03-bcae-f87311322901 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bbb4c0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:50.076824 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-daf703da-3d80-4f03-bcae-f87311322901 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4a6c4a21-342e-4244-96f1-37261f25293d" status: 200 len: 351 microversion: 2.1 time: 0.136344 Jun 29 16:09:50.083870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:09:49 2022] GET /compute/v2.1/os-volumes/4a6c4a21-342e-4244-96f1-37261f25293d => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:50.092036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-66dffa2f-e2a8-48e6-afd9-2558415bb3c7 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436b98940>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:50.348979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-66dffa2f-e2a8-48e6-afd9-2558415bb3c7 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.262511 Jun 29 16:09:50.350077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1133 bytes} [Wed Jun 29 16:09:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:09:50.365638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cdefdbfd-50b6-48bb-9f90-c17173a11f39 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bbbb80>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:50.507529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cdefdbfd-50b6-48bb-9f90-c17173a11f39 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.148823 Jun 29 16:09:50.510891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1148 bytes} [Wed Jun 29 16:09:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:50.525066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b7f53379-37f1-4053-a1bf-516774fc029d tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bb7a60>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:50.698466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b7f53379-37f1-4053-a1bf-516774fc029d tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179199 Jun 29 16:09:50.699139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1133 bytes} [Wed Jun 29 16:09:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:09:50.711028 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6df0d7a-e9df-4f7d-97ca-9873aa5d50ed tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bbf820>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:50.872951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6df0d7a-e9df-4f7d-97ca-9873aa5d50ed tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.165716 Jun 29 16:09:50.873824 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1166 bytes} [Wed Jun 29 16:09:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:50.885667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e1a41a3b-5c3b-4ca5-ad45-bc1d173cb034 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bbf1f0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:51.065342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e1a41a3b-5c3b-4ca5-ad45-bc1d173cb034 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.182716 Jun 29 16:09:51.066724 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1169 bytes} [Wed Jun 29 16:09:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:51.080135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-189a98a3-ba9c-4ec1-8d4a-4e95c2b1fee0 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bbf790>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:51.287115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-189a98a3-ba9c-4ec1-8d4a-4e95c2b1fee0 tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.212052 Jun 29 16:09:51.288540 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 9/17] 10.222.0.47 () {58 vars in 1154 bytes} [Wed Jun 29 16:09:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:09:51.301722 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3bb6973e-7cc9-4062-85d3-209305b9f3ab tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436b98f70>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:51.476198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3bb6973e-7cc9-4062-85d3-209305b9f3ab tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.179333 Jun 29 16:09:51.477868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 9/18] 10.222.0.47 () {58 vars in 1187 bytes} [Wed Jun 29 16:09:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:09:51.491051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5385fa89-1c4c-4bd9-8838-9d4b7ba18fbf tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] Calling method '.version_select at 0x7f0436bbbf70>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:09:51.665641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5385fa89-1c4c-4bd9-8838-9d4b7ba18fbf tempest-VolumesTestJSON-1961741707 tempest-VolumesTestJSON-1961741707-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.178878 Jun 29 16:09:51.666229 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 10/19] 10.222.0.47 () {58 vars in 1154 bytes} [Wed Jun 29 16:09:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:09:56.163550 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7478c67c-29bc-4f2a-9110-b36bd80e5d36 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'create', calling method: .version_select at 0x7f0436bbf820>, body: {"keypair": {"name": "tempest-keypair-1980448045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJuqhm07XDmznE47GL5lJR/BpDr40zNDHphvZKaUKsAksMdV30X7U+rQJZY/wAnLJ+nHvV9eMbEVzWLovFno4SSLBMeQiaD0VuUqnirIxi1/UfheMWDM2bI2ts0igorPA=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:09:56.262031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-7478c67c-29bc-4f2a-9110-b36bd80e5d36 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for project 3910745b858045628982687e473c23b7. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:09:56.273673 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-7478c67c-29bc-4f2a-9110-b36bd80e5d36 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for user d75d976f2c554209bc4c64d338ad7cf7 and project 3910745b858045628982687e473c23b7. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:09:56.368621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7478c67c-29bc-4f2a-9110-b36bd80e5d36 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.936064 Jun 29 16:09:56.369555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 10/20] 10.222.0.47 () {62 vars in 1199 bytes} [Wed Jun 29 16:09:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 938 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 16:09:56.977411 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-480670500", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "networks": [{"uuid": "21d5652b-ebdf-4f62-8dff-3c7d8917f3da"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:09:57.205568 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] validate_networks() for [('21d5652b-ebdf-4f62-8dff-3c7d8917f3da', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:10:00.282594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1247128662", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:00.506098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] validate_networks() for [('02207256-1ae5-4ba0-a64e-1eb06f43dbfd', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:10:01.845545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:10:01.846034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:10:01.846800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:10:01.847317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:10:01.848007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:10:01.877633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:01.878296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:01.879391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:01.880127 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:01.961429 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Getting quotas for project a0add8dd81ce48dda51cbca71cd875d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:01.992879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Getting quotas for user ba6701e26058440fa098a6a0e9da7f1a and project a0add8dd81ce48dda51cbca71cd875d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:02.033723 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:10:02.049356 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:10:02.323812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c7b033e7-d7b5-41b4-afa3-848b8440aff1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.088222 Jun 29 16:10:02.324506 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 11/21] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 6092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:10:02.342314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c9ea92fc-6e5a-48b8-a77a-7b7bdb83d033 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:02.342993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c9ea92fc-6e5a-48b8-a77a-7b7bdb83d033 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:02.871917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9ea92fc-6e5a-48b8-a77a-7b7bdb83d033 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:02.897757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c9ea92fc-6e5a-48b8-a77a-7b7bdb83d033 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1214 microversion: 2.1 time: 0.565277 Jun 29 16:10:02.909760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 12/22] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:02 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1214 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:03.242343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e04ceb1c-60fc-47e5-a3e2-83248f6ccfd7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: .version_select at 0x7f0436aba5e0>, body: {"keypair": {"name": "tempest-keypair-1964214611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNatjzJurhtrGW27cCemxd2kh7I4tydO2IOS/uuMeZG+knlabRoYtqmUPFu5UA09OjGztsW6oB5lsceg34NeG8bmjHJ1GFuDCgiIF4JpARvaPHJgx2EIGT1T1iCBJBLDDQ=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:03.261789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:10:03.262244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:10:03.262563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:10:03.263344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:10:03.264105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:10:03.285820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:03.292360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:03.293242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e04ceb1c-60fc-47e5-a3e2-83248f6ccfd7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for project 3fa6a9273bf24c67bfc20849da531320. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:03.293544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:03.294077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:03.314709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e04ceb1c-60fc-47e5-a3e2-83248f6ccfd7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for user 5b45e8b15637406eb145ca6e756e1f44 and project 3fa6a9273bf24c67bfc20849da531320. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:03.337097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:03.341822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for user 1c00db02926f4d849249c3990fdf8308 and project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:03.367269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:10:03.375174 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:10:03.396046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e04ceb1c-60fc-47e5-a3e2-83248f6ccfd7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.493695 Jun 29 16:10:03.404321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 13/23] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:10:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:03.479272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0301b80-ab9b-4c44-a33d-512649362aa0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: .version_select at 0x7f0435a70820>, body: {"keypair": {"name": "tempest-keypair-1219214197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRvEplYV+yNO8Q8iYv7sgMDhPgEgiux5Yv0DGZAsimHQ46ABjwEqikcyQ9sxzuvv/sAUKM8snZu6hQCqe1X7vfWpZaPqZIv8blTB+RL4HBWUhfyzcVQwrZdIDB+rxWXzA=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:03.513627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e0301b80-ab9b-4c44-a33d-512649362aa0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:03.520785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e0301b80-ab9b-4c44-a33d-512649362aa0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:03.538046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b50d4fa9-0182-4085-9ea4-86ee88811463 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.536531 Jun 29 16:10:03.538798 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 11/24] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:09:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 16:10:03.554529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-37121080-ec52-4a27-b986-e169331e506f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:03.555155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-37121080-ec52-4a27-b986-e169331e506f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:03.561458 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0301b80-ab9b-4c44-a33d-512649362aa0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152792 Jun 29 16:10:03.564991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 14/25] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:10:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:03.812830 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-37121080-ec52-4a27-b986-e169331e506f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:03.841883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-37121080-ec52-4a27-b986-e169331e506f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1222 microversion: 2.1 time: 0.293617 Jun 29 16:10:03.847725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 12/26] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:03 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:03.917418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c018a89-2f53-4e57-9708-cc02bcf74fae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:03.918095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5c018a89-2f53-4e57-9708-cc02bcf74fae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:04.010591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-644831708", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:04.124761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] validate_networks() for [('02207256-1ae5-4ba0-a64e-1eb06f43dbfd', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:10:04.559687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5c018a89-2f53-4e57-9708-cc02bcf74fae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:04.573735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5c018a89-2f53-4e57-9708-cc02bcf74fae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1214 microversion: 2.1 time: 0.657030 Jun 29 16:10:04.576583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:03 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1214 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:05.590696 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:05.591395 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:05.605566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:05.606018 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:05.618543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:05.625161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:06.410990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:06.440430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9f33b489-dfd6-46a7-bc8a-2a067b6a7e4c tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1210 microversion: 2.1 time: 0.851755 Jun 29 16:10:06.446746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 16/28] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:05 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1210 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:06.470767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-690319004", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23d87460-3054-4323-bbfc-60f319d2d13d"}], "security_groups": [{"name": "tempest-securitygroup--1843595648"}], "key_name": "tempest-keypair-1980448045", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:06.553438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:10:06.555400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:10:06.556144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:10:06.556831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:10:06.558387 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:10:06.612406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:06.615285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:06.616505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:06.617100 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:06.665286 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:06.695691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for user 1c00db02926f4d849249c3990fdf8308 and project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:06.771383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:10:06.783130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:10:06.953079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e7e2ea91-b9bf-4fd9-9f10-5a2d03df828d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.943572 Jun 29 16:10:06.962456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 13/29] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:10:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 16:10:06.978259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c60c4e0b-832a-4616-bf9c-9671eecb58e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:06.978893 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c60c4e0b-832a-4616-bf9c-9671eecb58e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:07.012833 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] validate_networks() for [('23d87460-3054-4323-bbfc-60f319d2d13d', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:10:07.332813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c60c4e0b-832a-4616-bf9c-9671eecb58e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:07.341784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c60c4e0b-832a-4616-bf9c-9671eecb58e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1221 microversion: 2.1 time: 0.377281 Jun 29 16:10:07.352034 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 14/30] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:06 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1221 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:07.463104 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:07.463908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:07.492218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:07.494471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:07.495586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:07.508005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:08.256219 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:08.271800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ecb1cce3-593b-478c-86e9-bc59f5a18648 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1272 microversion: 2.1 time: 0.812641 Jun 29 16:10:08.273332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 15/31] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:07 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1272 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:08.368289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:08.368914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:08.380289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:08.380748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:08.386977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:08.387583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:08.593813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:08.605173 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-20a2138b-2575-4099-8729-4657fa5b038a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1217 microversion: 2.1 time: 0.241148 Jun 29 16:10:08.612158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 16/32] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:08 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:09.291083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:09.292535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:09.306709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:09.307171 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:09.307977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:09.321357 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:10.352055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:10.360837 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-912d403d-2c1c-4c39-aa53-4497f7760143 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1272 microversion: 2.1 time: 1.075352 Jun 29 16:10:10.361480 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 17/33] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:09 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1272 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:10.382967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:10.383695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:10.423566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:10.436496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:10.442575 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:10.443259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:10.995797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:11.016167 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0d1ff67f-2446-470c-b9ab-a85027fc6152 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1279 microversion: 2.1 time: 0.653010 Jun 29 16:10:11.034934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 18/34] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:10 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1279 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:11.386262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:11.388493 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:11.409293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:11.415043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:11.416950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:11.420802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:11.721348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:11.747873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d5fe481e-f277-4c15-a791-fd501e4bea67 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1272 microversion: 2.1 time: 0.369203 Jun 29 16:10:11.750548 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 19/35] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:11 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:11.898836 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:12.048112 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:12.048738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:12.072400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:12.072965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:12.078318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:12.079770 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:12.584839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:12.605706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0bec55a2-e1dd-44f2-97b9-2971a02eeb27 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1279 microversion: 2.1 time: 0.556538 Jun 29 16:10:12.606451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 20/36] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:12 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1279 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:12.770330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:12.770957 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:12.807544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:12.808562 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:12.809229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:12.809674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:13.134032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:13.144733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-38a3abbd-c631-43af-af16-85d77e33cb6a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1272 microversion: 2.1 time: 0.382408 Jun 29 16:10:13.154472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 21/37] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:12 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:13.354311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:10:13.355042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:10:13.357486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:10:13.357974 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:10:13.358396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:10:13.392841 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:13.394102 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:13.397467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:13.398438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:13.476051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for project 3910745b858045628982687e473c23b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:13.488888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for user d75d976f2c554209bc4c64d338ad7cf7 and project 3910745b858045628982687e473c23b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:13.512789 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:10:13.517593 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:10:13.623004 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:13.624348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:13.637972 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-078bec5c-c376-45fd-8396-b21ec8614a6e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 7.189979 Jun 29 16:10:13.641689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:13.642559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:13.643632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:13.646909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 17/38] 10.222.0.47 () {62 vars in 1187 bytes} [Wed Jun 29 16:10:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 7199 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 16:10:13.647666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:13.665726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cc9b69f3-28c6-4d4b-8a54-90403b525698 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:13.672157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cc9b69f3-28c6-4d4b-8a54-90403b525698 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:13.849226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cc9b69f3-28c6-4d4b-8a54-90403b525698 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:13.862670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cc9b69f3-28c6-4d4b-8a54-90403b525698 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:13.865442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cc9b69f3-28c6-4d4b-8a54-90403b525698 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:13.869539 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cc9b69f3-28c6-4d4b-8a54-90403b525698 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1281 microversion: 2.20 time: 0.218049 Jun 29 16:10:13.872889 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 18/39] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:13 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:14.163704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:14.164453 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:14.176254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:14.176517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:14.179468 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:14.180161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:14.356594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:14.373228 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f59f5b27-7637-4327-8ca7-68ce86dfb6c7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1279 microversion: 2.1 time: 0.754418 Jun 29 16:10:14.378017 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 22/40] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:13 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1279 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:14.890809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4d351ff3-7e5e-477a-b416-f29157b9a923 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:14.891464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4d351ff3-7e5e-477a-b416-f29157b9a923 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:15.090270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4d351ff3-7e5e-477a-b416-f29157b9a923 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:15.110436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4d351ff3-7e5e-477a-b416-f29157b9a923 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:15.114699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4d351ff3-7e5e-477a-b416-f29157b9a923 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:15.127265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4d351ff3-7e5e-477a-b416-f29157b9a923 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1281 microversion: 2.20 time: 0.230675 Jun 29 16:10:15.128754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 23/41] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:14 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:15.148850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-853369669", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d31a991-2d95-49d3-82c4-03bcb2a7b773"}], "security_groups": [{"name": "tempest-securitygroup--1548460030"}], "key_name": "tempest-keypair-1219214197", "user_data": "}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:15.445257 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] validate_networks() for [('1d31a991-2d95-49d3-82c4-03bcb2a7b773', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:10:15.525955 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:15.535187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-32d8b4e4-cafb-491f-bb66-67f0ee1f13ab tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 1.376166 Jun 29 16:10:15.549682 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 19/42] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:14 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:15.557479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1189155686", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8b4a59a-8d13-4d0c-b500-ca8a3cc543b2"}], "security_groups": [{"name": "tempest-securitygroup--1504497498"}], "key_name": "tempest-keypair-1964214611", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:16.641429 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:10:16.642742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:10:16.643554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:10:16.647786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:10:16.648730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:10:16.658218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=4 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:16.669124 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:16.670010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:16.672158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:16.673315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:16.675938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] validate_networks() for [('a8b4a59a-8d13-4d0c-b500-ca8a3cc543b2', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:10:16.700586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:16.706048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:16.774721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:10:16.784550 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:10:16.960060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7e2f63fe-e3a9-4cb1-9609-7b6fa111d789 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.829389 Jun 29 16:10:16.962316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 24/43] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:10:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:10:16.996006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:16.997368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:17.028336 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:17.032515 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:17.034200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:17.035306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:17.242771 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:17.254478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fa7692f1-9eb0-47d4-8e05-ade92b81c2a5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1279 microversion: 2.1 time: 0.290905 Jun 29 16:10:17.257014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 25/44] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:16 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:17.272207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:17.273041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:17.291984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:17.295096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:17.304762 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:17.305447 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:17.454815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:17.471248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:17.474571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:17.475898 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3e478f8f-0f6c-4a68-987a-f884e53a506f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.216251 Jun 29 16:10:17.476971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 26/45] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:17 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:17.482042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:17.482787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:17.490180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:17.490853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:17.491934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:17.492509 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:17.744885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:17.763212 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d9bb17e2-ae28-4a8a-9b2c-3342ab4958ac tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.284500 Jun 29 16:10:17.772624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 27/46] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:17 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:17.777849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3ad2b94c-3606-40fb-8e8f-13b36bfc02f0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:17.783304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3ad2b94c-3606-40fb-8e8f-13b36bfc02f0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:17.793308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:17.882576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3ad2b94c-3606-40fb-8e8f-13b36bfc02f0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:17.889544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3ad2b94c-3606-40fb-8e8f-13b36bfc02f0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1241 microversion: 2.1 time: 0.115407 Jun 29 16:10:17.891023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 28/47] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:17 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:18.273719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:18.275663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:18.284185 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:18.284669 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:18.285638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:18.286065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:18.353135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:18.361754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-38e14a85-4d69-4fc6-8538-16917f266f43 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1279 microversion: 2.1 time: 0.092592 Jun 29 16:10:18.362983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 29/48] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:18 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:18.497183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:18.497902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:18.508390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:18.508842 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:18.509601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:18.516537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:18.619004 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:18.634136 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:18.637102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:18.638839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e0d9d4e0-dc5c-442f-998f-3667887ce322 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.146433 Jun 29 16:10:18.640759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 30/49] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:18 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:18.786624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:18.787397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:18.796802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:18.804695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:18.805712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:18.806157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.160973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:10:19.162254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:10:19.163083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:10:19.163640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:10:19.164229 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:10:19.181017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.181476 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.182278 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.183461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.210246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for project 3fa6a9273bf24c67bfc20849da531320. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:10:19.215059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for user 5b45e8b15637406eb145ca6e756e1f44 and project 3fa6a9273bf24c67bfc20849da531320. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:10:19.258650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:10:19.261923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:10:19.360065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5f4aa6f2-eaf2-4841-9f4f-635f74450496 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.808423 Jun 29 16:10:19.361528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 20/50] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:10:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:10:19.366731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:19.367759 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:19.379163 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.380170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.381655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.382233 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.402400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:19.429753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7847c6c6-fa21-4f83-a313-96b81d256b95 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.646833 Jun 29 16:10:19.431758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 31/51] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:18 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:19.440723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-42f2b329-efbc-4e30-9f13-84932a1afaa4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:19.441654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-42f2b329-efbc-4e30-9f13-84932a1afaa4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:19.632790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:19.658607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d36de71c-b3ae-452f-bb34-aed1f55353e8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.295691 Jun 29 16:10:19.659207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 21/52] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:19 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:19.694644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:19.697891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:19.736200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.737651 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.742745 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.743854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.881412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-42f2b329-efbc-4e30-9f13-84932a1afaa4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:19.896781 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-42f2b329-efbc-4e30-9f13-84932a1afaa4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1238 microversion: 2.1 time: 0.463337 Jun 29 16:10:19.899079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 32/53] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:19 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1238 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:19.922919 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:19.924725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:19.948037 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.950559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:19.955100 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:19.956263 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.198295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:20.217432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:20.223615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:20.226611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b54890a0-669e-441c-8257-2c2f206e1807 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.324142 Jun 29 16:10:20.226897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:20.232696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 33/54] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:19 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:20.252174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c47b9996-cd3b-4e5c-a41f-728c4cd4c979 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.575264 Jun 29 16:10:20.253928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 22/55] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:19 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:20.377668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-c9595d59-9b5a-4775-8e3d-43eef1d64983 req-575ae148-af4a-4909-ab79-899cce8b3a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd", "tag": "8c5430ef-08ce-4e09-b34f-53198b507833"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:20.392371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-c9595d59-9b5a-4775-8e3d-43eef1d64983 req-575ae148-af4a-4909-ab79-899cce8b3a22 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.393851 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-c9595d59-9b5a-4775-8e3d-43eef1d64983 req-575ae148-af4a-4909-ab79-899cce8b3a22 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.442499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-c9595d59-9b5a-4775-8e3d-43eef1d64983 req-575ae148-af4a-4909-ab79-899cce8b3a22 service nova] Creating event network-changed:8c5430ef-08ce-4e09-b34f-53198b507833 for instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd on hv-cinder-84814 Jun 29 16:10:20.444778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-c9595d59-9b5a-4775-8e3d-43eef1d64983 req-575ae148-af4a-4909-ab79-899cce8b3a22 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 16:10:20.446939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.450717 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:20.451401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:20.456252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.457475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.458224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.466641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:20.474689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.475684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.478679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.479467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.491260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.compute.rpcapi [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 16:10:20.494276 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] Releasing lock "compute-rpcapi-router" {{(pid=117728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 16:10:20.528641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dfe5a7dd-4afb-4c2e-b16a-c45c5d1b5cdf None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294439 Jun 29 16:10:20.530185 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 34/56] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:20.674895 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:20.676454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:20.677429 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:20.682806 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2186bda0-fa5f-4594-9f67-4b6195bbf440 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.237628 Jun 29 16:10:20.684616 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.685346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.686219 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.686745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.693355 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 23/57] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:20 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:20.902291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:20.910449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f4b921f1-414a-47f2-8bac-d82f6f958fd3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.238163 Jun 29 16:10:20.911032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 35/58] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:20 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:20.924145 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:20.924867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:20.928858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:20.933816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.934498 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:20.935362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:20.935911 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.017899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:21.026614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-09d0c2fd-a333-4645-9af7-bca4441e875f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.110744 Jun 29 16:10:21.027145 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 24/59] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:20 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:21.254062 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:21.254663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:21.260793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.261242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.262008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.262446 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.268970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:21.270058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:21.276036 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.276492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.277317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.277694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.333326 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:21.342165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:21.344778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:21.345501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ccb4c280-f23f-4bff-aadf-98a97fc52589 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.095248 Jun 29 16:10:21.355772 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 36/60] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:21 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:21.414252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:21.422231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7b6425c3-2843-4338-9e71-9f9df6447274 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.156890 Jun 29 16:10:21.422781 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 25/61] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:21 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:21.700317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:21.700865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:21.707061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.707509 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.708291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.708832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.853676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:21.862060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-794ad3ab-9ea5-42a5-8cb6-73800891f26b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.165364 Jun 29 16:10:21.862830 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 37/62] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:21 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:21.928038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:21.928650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:21.935298 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.935784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:21.936551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:21.936988 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.007531 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:22.015272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6bbc5054-9f67-45e9-9366-5704cb2f4be0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.092062 Jun 29 16:10:22.016103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 26/63] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:21 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:22.045703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:22.047341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:22.055131 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.055580 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.056413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.056916 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.135652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:22.145079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-250cf648-626c-48c1-9979-051be78de420 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.104175 Jun 29 16:10:22.146065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 38/64] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:22 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:22.364601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:22.365148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:22.371762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.372241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.373003 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.373445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.440905 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:22.441731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:22.446190 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:22.448238 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.448688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.449565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.450006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.457547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:22.459119 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:22.460358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b45cb75-273e-49ce-a1f8-a1c470b0b67d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.101686 Jun 29 16:10:22.460913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 27/65] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:22 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:22.546534 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-c77a3fd0-8af1-49f7-a519-24054719a756 req-686b556d-eeec-42fb-b24d-1255626f1074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf0d9bb-22cd-43e2-a70c-ea778282a1d7", "tag": "fb153181-1b50-4fe4-af4b-8c992e6820af"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:22.558288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c77a3fd0-8af1-49f7-a519-24054719a756 req-686b556d-eeec-42fb-b24d-1255626f1074 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.558928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c77a3fd0-8af1-49f7-a519-24054719a756 req-686b556d-eeec-42fb-b24d-1255626f1074 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.602515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-c77a3fd0-8af1-49f7-a519-24054719a756 req-686b556d-eeec-42fb-b24d-1255626f1074 service nova] Creating event network-changed:fb153181-1b50-4fe4-af4b-8c992e6820af for instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 on hv-cinder-84814 Jun 29 16:10:22.603003 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c77a3fd0-8af1-49f7-a519-24054719a756 req-686b556d-eeec-42fb-b24d-1255626f1074 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 16:10:22.604461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.605203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.606349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.606781 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.613578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:22.622037 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1aa366f0-fb66-41b9-84c0-50bc4f909264 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.184981 Jun 29 16:10:22.622617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 39/66] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:22 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:22.624042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.compute.rpcapi [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 16:10:22.625150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 16:10:22.655501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6af0a7c5-3b33-46d0-b199-be0b34a15df4 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113917 Jun 29 16:10:22.656912 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 28/67] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:22.880471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:22.881171 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:22.888067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.888821 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:22.895499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:22.895499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.026392 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.032861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:23.033841 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:23.035565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-623cbca1-0a67-4322-a32c-f6a4a6586b0e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.159075 Jun 29 16:10:23.036201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 40/68] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:22 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:23.040634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.041164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.042052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.042675 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.109642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.117293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0e512ae-b38d-48a3-92af-54d183af974b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.089013 Jun 29 16:10:23.117864 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 29/69] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:23 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:23.161971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:23.162576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:23.168536 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.168979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.169750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.170159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.260417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.272651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-51556c6e-3257-4d31-9ca9-a627df604c04 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.114418 Jun 29 16:10:23.273516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 41/70] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:23 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:23.478412 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:23.479123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:23.485428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.485878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.486660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.487098 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.573569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.588139 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.589478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.590586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5aa7bd43-07e6-4518-9ec2-4e8da541bf50 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.116067 Jun 29 16:10:23.591304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 30/71] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:23 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:23.638848 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:23.639473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:23.646398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.646847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.647599 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:23.648080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:23.808384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:23.818957 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-58321104-2c16-45f6-880f-44440b839931 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.184103 Jun 29 16:10:23.819555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 42/72] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:23 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:24.052320 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:24.053344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:24.060873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.061352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.062781 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.063525 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.136221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:24.137662 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:24.146953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.147683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.153216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.153868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.222004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:24.230469 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-42607d03-fe54-424c-9ee4-441cfd7222a9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.181953 Jun 29 16:10:24.231052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 31/73] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:24 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:24.253610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:24.261512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b6dc87bc-f5e3-485c-a7ce-1aff308d8095 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.130234 Jun 29 16:10:24.262096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 43/74] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:24 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:24.290926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:24.291804 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:24.298976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.299426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.300222 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.300655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.370138 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:24.381560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9eb40758-eddd-49c0-98de-98a42d90d3f1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.093197 Jun 29 16:10:24.381560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 32/75] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:24 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:24.611293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:24.612099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:24.618226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.618666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.619407 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.619847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.702312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:24.711066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:24.712703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:24.713803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-653d1376-108a-403e-af1a-0a47add1d1af tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.106460 Jun 29 16:10:24.714356 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 44/76] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:24 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:24.835953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:24.836602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:24.842935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.843967 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:24.844917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:24.845353 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.090839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.099316 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0811bb7-8f4c-4cbe-b460-b039ca4a863c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.267040 Jun 29 16:10:25.104671 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 33/77] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:24 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:25.250055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:25.250733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:25.257896 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.259771 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.260782 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.261487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.280216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:25.282517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:25.294880 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.296351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.298154 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.298849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.471429 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.475116 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:25.488285 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79c985eb-4027-42fc-90cc-8f8d2ed30f00 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.214015 Jun 29 16:10:25.490062 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 34/78] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:25 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:25.505657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:25.506276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:25.529997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.530652 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.533284 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.534391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.558241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.572048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8ccac78f-2772-4b6b-9d1c-a46b41393d64 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.324644 Jun 29 16:10:25.572667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 45/79] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:25 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:25.635921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.644328 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f609a60-8f51-446a-ae62-9a61cd369805 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.153232 Jun 29 16:10:25.645243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 35/80] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:25 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:25.737977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:25.738947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:25.756917 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.757581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.758557 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:25.759188 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:25.855533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.867279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.869303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:25.870821 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-31fa4bdc-7cb8-43af-bca2-aa5958ece6c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.142097 Jun 29 16:10:25.871558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 46/81] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:25 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:26.123057 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:26.123780 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:26.130630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.131108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.131928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.132363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.308492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:26.317967 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e201dc1f-d117-4264-97f4-03465e9f203b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.198912 Jun 29 16:10:26.322920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 36/82] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:26 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:26.508345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:26.509836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:26.517520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.518442 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.519752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.520539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.585656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:26.594133 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-99a1c38d-314b-4495-89e3-c6038f8ef699 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.090078 Jun 29 16:10:26.594441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:26.594626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 47/83] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:26 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:26.596308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:26.606598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.607628 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.607812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.608275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.665354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:26.666168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:26.676771 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.680005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.680986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.681566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.768458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:26.786477 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-024bcf24-f64e-4efa-9e3c-be1f13732711 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.125736 Jun 29 16:10:26.787100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:26.787870 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 48/84] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:26 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:26.796314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5f233340-990e-4c9a-9b2a-7946df623dd8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.209572 Jun 29 16:10:26.797170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 37/85] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:26 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:26.891225 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:26.891944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:26.898134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.898576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.899332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:26.899759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:26.997284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.005428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.006960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.008086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-00d13578-aa49-44a2-9ec9-f52f27b1f41b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.121977 Jun 29 16:10:27.008646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 49/86] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:26 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:27.337446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:27.338613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:27.345719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.346253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.347158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.358253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.509963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.518367 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d880e894-47b0-4a56-98de-85daa79fea28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.187384 Jun 29 16:10:27.519320 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 38/87] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:27 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:27.611608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:27.612730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:27.623399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.623784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.625187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.625625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.703488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.711632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b2aa1c65-e6ef-4a48-a218-0fae26978056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.105210 Jun 29 16:10:27.712259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 50/88] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:27 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:27.803450 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:27.804105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:27.810389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.810840 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.811604 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.812632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.814704 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:27.815446 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:27.822865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.823448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.824362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:27.825081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:27.851872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:27.883667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.891592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b45d7d8-9386-4187-92f2-2fc793aee42d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.091957 Jun 29 16:10:27.892397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 39/89] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:27 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:27.989712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:27.997734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-db13a8e2-bd77-4517-96fe-91530194d1e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.187685 Jun 29 16:10:27.998316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 51/90] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:27 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:28.027159 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:28.027774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:28.035548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.036027 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.036791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.037222 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.145502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:28.153491 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:28.155005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:28.156910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fd95182-8872-4ece-9d16-f445d21acb28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.133680 Jun 29 16:10:28.157888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 40/91] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:28 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:28.534812 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:28.535603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:28.542008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.542736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.543563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.544179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.676711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:28.684836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-207b88a1-ffd6-4d35-af38-6071d1862ded tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.154267 Jun 29 16:10:28.685408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 52/92] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:28 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:28.728511 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:28.729124 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:28.735620 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.736090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.736845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.737276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.809302 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:28.816640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-66433878-923c-4ead-b123-edb6d88df59a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.091940 Jun 29 16:10:28.817375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 41/93] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:28 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:28.908211 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:28.908844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:28.914760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.915229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.916071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:28.916583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:28.976778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:28.984734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ac3597bc-ee1e-401e-84fe-9ee7312198c0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.080447 Jun 29 16:10:28.985359 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 53/94] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:28 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:29.014420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:29.015562 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:29.021769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.022197 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.022945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.023530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.154385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:29.162427 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc6d0ad4-c51b-4a8a-a84a-455bb134a198 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.151835 Jun 29 16:10:29.162914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 42/95] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:29 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:29.176839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:29.177437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:29.183287 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.183731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.184499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.184922 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.254312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:29.262302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:29.263799 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:29.265454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-13ddb17b-90f0-4b89-861b-d68586dac218 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.092021 Jun 29 16:10:29.266013 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 54/96] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:29 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:29.700690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:29.701293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:29.704156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=32 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:29.709704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.710261 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.711010 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.711601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.834265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:29.835000 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:29.843094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.843551 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.844350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:29.844789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:29.867272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:29.876495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-76b07cb5-ce67-478f-a1d6-a96f5ffb1207 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.179476 Jun 29 16:10:29.879879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 43/97] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:29 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:29.893496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=32 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:29.906870 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:29.914282 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ce4cbce7-1df7-46d4-860a-c66d076774de tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.084401 Jun 29 16:10:29.914850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 55/98] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:29 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:30.002290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:30.002904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:30.009020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.009467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.010225 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.010657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.071156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:30.078758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8dc63ff4-fd8a-42f5-9629-c15b2465aca2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.080867 Jun 29 16:10:30.079896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 44/99] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:29 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:30.178361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:30.178974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:30.185148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.185599 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.186352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.186823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.285448 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:30.286164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:30.292282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.292937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.293694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.294124 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.330743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:30.338113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2a7abea8-e6f2-4e6c-b42e-fb20c52e3edc tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.163576 Jun 29 16:10:30.338676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 56/100] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:30 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:30.366444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:30.374628 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:30.376186 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:30.377318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ba74607b-50f0-4601-b5b3-fc5f4d416f6b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.097302 Jun 29 16:10:30.377870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 45/101] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:30 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:30.893772 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:30.894380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:30.896231 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=4 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:30.901462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.901911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.902655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.903080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.931358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:30.932053 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:30.938639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.939083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:30.939865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:30.940304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.000304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.007642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b19eda4-7c86-41a6-a0ee-f84cf807adc3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1245 microversion: 2.1 time: 0.080040 Jun 29 16:10:31.008243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 46/102] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:30 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:31.030023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.037450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-91d54f39-3242-4a70-a976-aa555c66d358 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.147989 Jun 29 16:10:31.038006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 57/103] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:30 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:31.097093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:31.097696 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:31.104547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:31.105021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.105761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:31.106185 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.169470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.176748 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3bd98a0d-5748-4eda-a6a1-af2a75622fb9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1242 microversion: 2.1 time: 0.084335 Jun 29 16:10:31.177301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 47/104] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:31 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:31.354436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:31.354990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:31.361557 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:31.362005 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.362763 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:31.363195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.394276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:31.394852 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:31.400834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:31.401274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.402014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:31.402436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:31.466428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.474257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.475846 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.477150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-23822a16-9967-4b19-a77c-e9c4a8afd230 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.086709 Jun 29 16:10:31.477805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 48/105] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:31 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:31.496726 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:31.504672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f37db245-4ffb-408a-a8c6-02cef0b0c640 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.154123 Jun 29 16:10:31.505242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 58/106] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:31 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:32.026048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:32.026659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:32.038768 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.042322 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.045370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.046007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.054453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:32.055741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:32.069016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.069464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.070245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.072516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.219589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.230530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa246828-b298-42a2-8d24-4d5d9f40f1a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1237 microversion: 2.1 time: 0.208558 Jun 29 16:10:32.231809 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 49/107] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:32 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1237 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:32.237421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:32.238079 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:32.245470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.248056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.249092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.249739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.478143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.486513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b75b501d-7a22-4cb7-890c-5953dc3273df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1234 microversion: 2.1 time: 0.253289 Jun 29 16:10:32.487287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 50/108] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:32 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1234 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:32.502313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-43da53e4-0a84-464b-a938-db1ae1fabe4e req-aadb48f6-7e08-4a84-b07b-767a7757bfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f66543e-7e81-4899-afc9-ce96bb61bcaa", "tag": "348e22b7-2fb7-43b6-8faa-ccc5e3b72cd9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:32.510309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-43da53e4-0a84-464b-a938-db1ae1fabe4e req-aadb48f6-7e08-4a84-b07b-767a7757bfef service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.510740 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-43da53e4-0a84-464b-a938-db1ae1fabe4e req-aadb48f6-7e08-4a84-b07b-767a7757bfef service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.524382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-43da53e4-0a84-464b-a938-db1ae1fabe4e req-aadb48f6-7e08-4a84-b07b-767a7757bfef service nova] Creating event network-changed:348e22b7-2fb7-43b6-8faa-ccc5e3b72cd9 for instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa on hv-cinder-84814 Jun 29 16:10:32.529401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-43da53e4-0a84-464b-a938-db1ae1fabe4e req-aadb48f6-7e08-4a84-b07b-767a7757bfef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031225 Jun 29 16:10:32.530196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 51/109] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:32.535401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:32.536130 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:32.542363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.542835 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.544060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.544060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.548090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:32.550727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.558049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8674ef66-a22c-4dcc-8850-f2a0bfbb601b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.508916 Jun 29 16:10:32.558641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 59/110] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:32 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:32.565045 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:32.565649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:32.571792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.572261 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.573246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:32.573680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:32.615987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:32.619664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.628910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.630536 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.631650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b1a4626-e3f0-4526-b12b-260002ed60f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1339 microversion: 2.20 time: 0.100358 Jun 29 16:10:32.632363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 52/111] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:32 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:32.772603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:32.782579 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5dcb74a7-08c3-42df-adeb-a8ce73a37e41 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.220583 Jun 29 16:10:32.783779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 60/112] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:32 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:33.247990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:33.248598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:33.257756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.258202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.258975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.259399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.503951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:33.505177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:33.517859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.519051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.521050 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.524117 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.647992 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:33.657792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:33.658010 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9f1a3424-0a45-4e34-8399-2bf5ef5fc6c2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1301 microversion: 2.1 time: 0.414001 Jun 29 16:10:33.658532 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 53/113] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:33 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1301 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:33.664006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:33.664785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:33.667207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-42695102-db64-485d-a56c-08049d0d977e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1308 microversion: 2.1 time: 0.167324 Jun 29 16:10:33.667888 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 61/114] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:33 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:33.680762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.682095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.682254 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:33.683226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.683672 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.684114 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:33.691974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.692946 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:33.694796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:33.695425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.022802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.035493 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.037627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.038997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-78a5d48d-9c77-4678-b35b-7a1367bbeae5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.369362 Jun 29 16:10:34.056533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 62/115] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:33 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:34.068592 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:34.071258 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:34.080461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.080461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.080862 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.091013 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.458590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.462156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.468976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7aefdfe5-5269-4e19-a974-d0217adcd301 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.808233 Jun 29 16:10:34.469658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 54/116] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:33 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:34.480250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e4cf53fe-9a30-475b-9a09-edba80181e72 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.418515 Jun 29 16:10:34.481329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 63/117] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:34 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:34.674524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:34.675307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:34.681594 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.682252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.683164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.683793 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.686736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:34.690800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:34.698505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.699427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.701034 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.703139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.751912 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.761405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-028b3e48-1473-4ea6-8530-60416ec47f10 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1299 microversion: 2.1 time: 0.090666 Jun 29 16:10:34.762090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 55/118] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:34 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:34.793044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:34.800746 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-404debe2-853e-45f3-b5ec-aa6dd855ade3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1296 microversion: 2.1 time: 0.119890 Jun 29 16:10:34.801320 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 64/119] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:34 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:34.863477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-6ac6ffc7-8260-4517-9136-d17c1b54bd1f req-941f32f6-0e22-4ad2-a5e5-fc74d5d0d600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:34.871933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6ac6ffc7-8260-4517-9136-d17c1b54bd1f req-941f32f6-0e22-4ad2-a5e5-fc74d5d0d600 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:34.872373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6ac6ffc7-8260-4517-9136-d17c1b54bd1f req-941f32f6-0e22-4ad2-a5e5-fc74d5d0d600 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:34.884065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-6ac6ffc7-8260-4517-9136-d17c1b54bd1f req-941f32f6-0e22-4ad2-a5e5-fc74d5d0d600 service nova] Creating event network-changed:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:10:34.888845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-6ac6ffc7-8260-4517-9136-d17c1b54bd1f req-941f32f6-0e22-4ad2-a5e5-fc74d5d0d600 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090333 Jun 29 16:10:34.889408 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 56/120] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:35.056989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:35.057547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:35.063534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.064024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.064753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.065183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.192108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.201397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.203596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.204711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ca2c86ed-9fef-4130-bccb-793d54b63cdc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.151708 Jun 29 16:10:35.205273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 65/121] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:35 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:35.486035 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:35.486726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:35.493119 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.493565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.494312 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.494809 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.500234 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:35.500968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:35.507386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.507850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.508605 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.509030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.634525 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.641508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.643918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3bc2a6c-bbdd-49e8-8eca-60d8d1160c62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.162239 Jun 29 16:10:35.644591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 57/122] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:35 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:35.649803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d8af5102-56aa-4649-99e5-cc373f49bfd2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.155280 Jun 29 16:10:35.650449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 66/123] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:35 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:35.778312 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:35.778914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:35.784949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.785393 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.786139 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.786572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.818259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:35.818865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:35.824998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.825438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.826200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:35.826630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:35.846367 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.853607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6525ce9b-20a7-42b1-8bfa-0decb0cc87f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1299 microversion: 2.1 time: 0.079070 Jun 29 16:10:35.854175 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 58/124] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:35 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1299 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:35.891532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:35.898914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a2dcfaa5-9b24-4051-a5a7-cc819b8efeaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1296 microversion: 2.1 time: 0.084455 Jun 29 16:10:35.899472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 67/125] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:35 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:36.223104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:36.223646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:36.229721 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.230164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.230913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.231340 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.356779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.365153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.366661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.367774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0e0c71d-4894-47c9-bd41-207438ba4aca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.148696 Jun 29 16:10:36.368353 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 59/126] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:36 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:36.661401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:36.662014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:36.666071 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:36.666669 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:36.668162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.668612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.669365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.669795 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.672609 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.673043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.673735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:36.673870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.674196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.803397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.804830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.811132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e55d02b3-6e69-4bdc-8a1a-e807fa8f189c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.153834 Jun 29 16:10:36.811814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 68/127] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:36 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:36.812297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4f4b79f-7eaa-4f2a-b8be-6306ed6984f7 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.149884 Jun 29 16:10:36.812855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 60/128] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:36 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:36.870629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:36.871707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:36.877859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.878302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.879051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.879481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.915467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:36.916175 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:36.922304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.922830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.923665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:36.924198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:36.940093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.947471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-df3df15c-26d8-406b-a582-56580a25d351 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1299 microversion: 2.1 time: 0.080504 Jun 29 16:10:36.948080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 69/129] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:36 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:36.984945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:36.992198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d33736a-8d08-40d7-8027-df22abb93fb2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1296 microversion: 2.1 time: 0.080527 Jun 29 16:10:36.992758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 61/130] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:36 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:37.385941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:37.386461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:37.393087 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:37.393520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:37.394251 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:37.394672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:37.529738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:37.537603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:37.539103 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:37.540340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3233d0a0-1637-4d6d-b210-f8805c8bfce0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.158330 Jun 29 16:10:37.540760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 70/131] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:37 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:37.828242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:37.829700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:37.831930 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:37.832753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:37.837304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:37.837939 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:37.838985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:37.839710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:37.843463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:37.844200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:37.845063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:37.847584 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.145441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:38.153726 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2341aacd-857a-4573-8516-beffa0d96df8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.328066 Jun 29 16:10:38.162139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 71/132] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:37 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:38.165859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:38.166492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:38.173169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:38.173850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.174813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:38.175443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.260760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:38.274147 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8fd50d31-a217-43cf-aa9b-2d983bcc7c76 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1299 microversion: 2.1 time: 0.116937 Jun 29 16:10:38.275132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 72/133] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:38 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:38.285879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:38.286784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:38.294556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:38.295358 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.296419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:38.297033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.331285 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:38.341081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0e538765-cf28-4209-8a64-3573e2f31ae4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.516867 Jun 29 16:10:38.341892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 62/134] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:37 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:38.569887 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:38.574035 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:38.586569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:38.599272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.603025 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:38.603484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:38.652683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:38.666766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0e2a71c0-f6cb-4d47-8ed3-3f805a2fdb62 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1296 microversion: 2.1 time: 0.385144 Jun 29 16:10:38.667951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 73/135] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:38 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1296 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:39.089005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.100365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.102295 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.103572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9a4bc35e-b47f-42d4-be03-f036deb8d915 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.548534 Jun 29 16:10:39.104373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 63/136] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:38 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:39.172255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:39.172861 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:39.178824 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.179242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.180019 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.180443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.292486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:39.293349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:39.303636 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.304377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.305320 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.309550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.321361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.329272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-de3293ce-5dc9-4c30-bfbc-46ced2bdea1f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.161046 Jun 29 16:10:39.329845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 74/137] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:39 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:39.358579 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:39.359426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:39.365544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.365982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.366731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.367162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.466169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.473816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f1c98f6-2f42-45ef-a4a0-87f5eb765459 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.185224 Jun 29 16:10:39.474382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 64/138] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:39 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:39.502197 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.509501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7be06292-92dd-47ef-b4d4-47d05b0b3192 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.154902 Jun 29 16:10:39.510056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 75/139] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:39 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:39.683341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:39.683984 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:39.690598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.691045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.691801 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:39.692256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:39.823916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:39.831694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6c7b634-5493-4a4f-aa49-722f5c9d55d0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.152125 Jun 29 16:10:39.832294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 65/140] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:39 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:40.121466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:40.122071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:40.128792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.129250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.129983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.130410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.258049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.266570 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.268139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.269237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0cbb9170-e26e-4bf0-840c-e7feb5ec6659 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.151940 Jun 29 16:10:40.269793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 76/141] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:40 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:40.346279 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:40.346908 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:40.352926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.353371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.354121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.354552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.479493 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.487372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b981bb2c-9d58-41b7-baf3-817fa182cc59 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.145087 Jun 29 16:10:40.488068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 66/142] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:40 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:40.490635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:40.491236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:40.494177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:40.498288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.498728 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.500108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.500540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.526174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:40.526770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:40.532736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.533176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.533918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.534338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.629659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.637443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8390c552-5ff0-4135-b776-e35f463170aa tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.150693 Jun 29 16:10:40.638015 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 77/143] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:40 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:40.674976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.683121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a5013dc8-7e93-4b78-9192-6073b8bcf562 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.160620 Jun 29 16:10:40.683677 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 67/144] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:40 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:40.848314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:40.848921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:40.854990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.855431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.856206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:40.856636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:40.988743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:40.996339 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b24a3835-8a00-4442-8b60-8ad02d722aa5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.151496 Jun 29 16:10:40.996929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 78/145] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:40 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:41.286814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:41.287419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:41.293394 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.293836 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.294578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.295005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.420357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:41.428711 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:41.430239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:41.431329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d2332298-4c1f-4c95-a0dd-eec836cd024c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.148406 Jun 29 16:10:41.431895 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 68/146] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:41 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:41.504425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:41.505055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:41.511059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.511496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.512259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.512685 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.636691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:41.643995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-57c353c3-3911-46ef-b74f-34fd54ef5b8f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.143418 Jun 29 16:10:41.644551 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 79/147] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:41 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:41.654617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:41.655220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:41.662227 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.662668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.663421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.663870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.682992 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:41.699615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:41.700262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:41.710529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.711115 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.712632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:41.712632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:41.814047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:41.821508 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6689c35-6385-465d-9d60-a2288dbf15e4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.170654 Jun 29 16:10:41.822072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 69/148] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:41 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:41.845488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:41.853239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e34b348d-bd7d-4a25-a222-3a3335279679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.157521 Jun 29 16:10:41.853803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 80/149] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:41 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:42.013569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:42.014194 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:42.020689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.021132 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.021874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.022300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.147856 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:42.155855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bfdf8608-4606-4d2d-8f3a-e8e75ca5aebf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.146032 Jun 29 16:10:42.156583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 70/150] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:42 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:42.449342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:42.449852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:42.456529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.456968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.457707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.458127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.584687 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:42.592448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:42.593941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:42.595051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1ff7fa75-6ef2-49ae-80e5-b98d70ac8ff5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.149695 Jun 29 16:10:42.595600 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 81/151] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:42 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:42.660213 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:42.660880 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:42.666951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.667395 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.668180 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.668613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.798494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:42.806134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93c1ef83-d635-4c9b-a8f2-53e88d77c1dd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.149839 Jun 29 16:10:42.806690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 71/152] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:42 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:42.838224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:42.838829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:42.844769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.845205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.845945 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.846370 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.871107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:42.871720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:42.881397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.881844 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.882779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:42.883292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:42.977430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:42.985604 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1eafd4dd-0800-4edf-80f3-0e579e4226cf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.150518 Jun 29 16:10:42.986167 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 82/153] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:42 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:43.016550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:43.023782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7d283f06-63ed-46aa-9ce3-8b3a1e4145ae tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.157350 Jun 29 16:10:43.024365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 72/154] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:42 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:43.173547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:43.174143 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:43.180098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:43.180538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:43.181275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:43.181697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:43.319934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:43.327303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-21344a0a-18c9-45f7-b20c-b5811645e96f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.158241 Jun 29 16:10:43.327872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 83/155] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:43 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:43.613043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:43.613555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:43.619525 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:43.619997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:43.620746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:43.621429 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:43.746275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:43.756591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:43.758884 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:43.760442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff31dd93-ff81-46d3-a578-341b1945bc20 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.151405 Jun 29 16:10:43.761005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 73/156] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:43 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:43.822283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:43.822885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:43.829936 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:43.830720 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:43.831537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:43.831980 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:43.971918 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:43.975314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:43.979749 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cb95f31d-c8cb-464e-abf8-12a795f4c3a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.161247 Jun 29 16:10:43.980340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 84/157] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:43 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:44.003308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:44.003955 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:44.006826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:44.011026 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.011471 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.012258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.012692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.041244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:44.041848 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:44.048416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.048860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.049601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.050031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.145265 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:44.152592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0db431b1-d381-4f53-bbf0-80275e370b45 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.153867 Jun 29 16:10:44.153156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 74/158] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:43 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:44.179701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:44.186973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d237be00-89dd-48b7-b9f0-8db9bb3191e5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.149843 Jun 29 16:10:44.187522 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 85/159] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:44 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:44.344531 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:44.345131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:44.351068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.351509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.352283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.352715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.476943 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:44.484282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b827f6a-9491-41b9-88a8-aac5dced4e7c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.143515 Jun 29 16:10:44.485470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 75/160] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:44 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:44.779097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:44.779474 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:44.786265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.786710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.787536 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:44.787913 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:44.915382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:44.923137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:44.924664 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:44.925742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-53d597c2-b0fb-4534-ae69-8215f79dc9fd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.150772 Jun 29 16:10:44.926280 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 86/161] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:44 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:44.997005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:44.997611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:45.003660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.004145 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.004899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.005332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.135435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:45.143314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2ff4497b-784e-4523-93ee-ae157d01cf70 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.150336 Jun 29 16:10:45.143894 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 76/162] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:44 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:45.169267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:45.169868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:45.176145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.176586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.177585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.178014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.204489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:45.205085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:45.211003 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.211440 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.212208 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.212634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.304177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:45.311636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fd5c872d-cd82-41cc-9ea6-d935e1175eb4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.146404 Jun 29 16:10:45.312230 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 87/163] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:45 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:45.339095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:45.346451 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1d0af17-1e09-4c9f-a907-b56865079937 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.146266 Jun 29 16:10:45.347004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 77/164] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:45 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:45.502480 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:45.503081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:45.509146 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.509583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.510323 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.510752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.637071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:45.644404 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8fdecbb6-0667-4690-b6d1-558158f6eb4f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.146388 Jun 29 16:10:45.644961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 88/165] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:45 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:45.943568 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:45.944272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:45.950194 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.950628 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:45.951399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:45.951774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.087058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.094842 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.096361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.097441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-487a469f-54aa-4673-8d00-82d102e5ba99 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.157760 Jun 29 16:10:46.097995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 78/166] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:45 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:46.159840 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:46.160464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:46.166566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.166959 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.167707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.168163 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.291919 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.300126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f9271ab4-86ef-494d-af28-3cddf4dc12a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.144014 Jun 29 16:10:46.300695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 89/167] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:46 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:46.328687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:46.329290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:46.335103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.335538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.336307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.336733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.362649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:46.363245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:46.369424 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.369865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.370612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.371299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.469391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.476759 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e02e6795-cbba-4f08-821d-9bc181731265 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.151829 Jun 29 16:10:46.477321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 79/168] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:46 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:46.510016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.517313 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2c7ba036-2474-4282-8ce3-87df795217f9 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.158889 Jun 29 16:10:46.517866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 90/169] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:46 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:46.661513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:46.662115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:46.668190 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.668573 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.669316 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:46.669742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:46.796313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:46.804247 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3251d6cf-2f55-460c-8779-80f4b33112e8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.146542 Jun 29 16:10:46.804819 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 80/170] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:46 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:47.115070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:47.115670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:47.122043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.122494 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.123240 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.123676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.248496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.257015 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.258504 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.259581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5f4f8de3-17dd-4189-8f76-d97300275274 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.148448 Jun 29 16:10:47.260166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 91/171] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:47 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:47.316998 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:47.317601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:47.323565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.324032 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.324781 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.325201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.452629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.459875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2edb078e-926b-49c8-ab84-4cc501e43e78 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.147244 Jun 29 16:10:47.460433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 81/172] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:47 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:47.493152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:47.493748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:47.499973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.500351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.501085 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.501505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.534312 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:47.534916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:47.540934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.541378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.542136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.542563 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.626377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.633934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3b47bd71-fd87-4bd6-8af7-8dac21bc01af tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.144503 Jun 29 16:10:47.634681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 92/173] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:47 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:47.673011 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.680211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2855bc4e-3b98-4a19-8aac-c427e42d8577 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.150125 Jun 29 16:10:47.680784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 82/174] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:47 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:47.820328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:47.820882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:47.826933 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.827372 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.828198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:47.829386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:47.960605 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:47.968460 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6b491718-fb07-42d5-8b8c-964c43093240 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.152053 Jun 29 16:10:47.969640 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 93/175] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:47 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:48.277133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:48.277786 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:48.285835 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.286288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.287173 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.287934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.427348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:48.435147 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:48.436666 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:48.437742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7d722adb-31b2-43b6-a484-dce0cb56471d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.164576 Jun 29 16:10:48.438293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 83/176] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:48 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:48.475843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:48.476454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:48.482361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.482799 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.483534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.483985 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.613783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:48.621404 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-77b6e01e-de40-4300-9cce-123e3cee2529 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.149066 Jun 29 16:10:48.621953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 94/177] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:48 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:48.650300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:48.650818 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:48.657350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.657790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.658531 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.658955 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.697414 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:48.698015 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:48.704604 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.705137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.705893 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.706321 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.787949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:48.795370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac542a4b-cbd6-4559-84d8-f5730cd8f598 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.148912 Jun 29 16:10:48.795980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 84/178] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:48 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:48.837808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:48.845212 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8e61c0d6-34e1-4b36-a24b-9973a5b4b1a3 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.151581 Jun 29 16:10:48.846347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 95/179] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:48 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:48.986339 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:48.986973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:48.992971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.993410 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:48.994156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:48.994585 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.123052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:49.130330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b29aeb33-6c75-4c5c-bce7-ac628a014788 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.148433 Jun 29 16:10:49.131153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 85/180] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:48 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:49.456296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:49.456891 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:49.463056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.463419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.464191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.464617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.592283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:49.600791 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:49.602273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:49.603361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fd52da32-3e2b-4be1-8968-74100f3e43bf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.151398 Jun 29 16:10:49.603927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 96/181] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:49 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:49.638038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:49.638644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:49.646072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.646511 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.647377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.647809 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.663620 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:49.796478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:49.804287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e16543ce-fef8-4eda-8bf6-1f053585c7cc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.169993 Jun 29 16:10:49.804866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 86/182] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:49 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:49.814053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:49.814876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:49.823294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.823737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.824531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.824956 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.862455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:49.863056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:49.869730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.870171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.870917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:49.871774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:49.968395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:49.976066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-33527dad-f52e-4cd6-892e-269ee2bc4417 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.167799 Jun 29 16:10:49.977221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 97/183] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:49 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:50.017484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:50.025650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b131785-8721-472d-a0f5-f47399cdc881 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.167150 Jun 29 16:10:50.026209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 87/184] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:49 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:50.148334 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:50.148961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:50.154908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:50.155342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:50.156113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:50.157098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:50.319708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:50.327454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f95c0721-1910-44d9-8757-1fc08bb9bb70 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.183288 Jun 29 16:10:50.328040 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 98/185] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:50 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:50.621522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:50.622321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:50.629346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:50.629786 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:50.630528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:50.630952 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:50.794668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:50.803309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:50.804771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:50.805843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-055eca7e-b4a5-4adb-a839-f433eb20aca3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.188468 Jun 29 16:10:50.806649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 88/186] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:50 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:50.821346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:50.821940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:50.828761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:50.829246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:50.830032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:50.830458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:50.994422 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:50.995020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:51.001784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.002223 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.003045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.003537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.008619 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.016933 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-24d403e5-b034-4446-832c-f099140e5fbc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.199482 Jun 29 16:10:51.017777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 99/187] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:50 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:51.042325 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:51.042828 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:51.049492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.050114 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.050882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.051313 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.153640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.162597 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0067dea4-4043-4ca4-9e65-a7698f6c3a88 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.172474 Jun 29 16:10:51.163190 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 89/188] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:50 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:51.206816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.215074 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-140f47f5-f43a-467f-aa47-74555bdc55b6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.176494 Jun 29 16:10:51.215973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 100/189] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:51 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:51.344835 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:51.345432 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:51.351706 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.352108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.352857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.353352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.494655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.502956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1185b539-a9b2-40d1-900f-64dd041df2aa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.161997 Jun 29 16:10:51.503501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 90/190] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:51 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:51.825767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:51.826365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:51.834312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.835302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.836222 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:51.836660 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:51.856576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:51.974907 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.982836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.984375 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:51.986031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-847292b4-6260-480e-99f8-93f89b1d7e2f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.165543 Jun 29 16:10:51.986615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 101/191] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:51 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:10:52.034479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:52.035103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:52.041059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.041506 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.042264 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.042690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.183265 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:52.185982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:52.187183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:52.191443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6ddeddb-6bad-437b-8fa2-96783dfc0ddb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.161438 Jun 29 16:10:52.192308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 91/192] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:52 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:52.197068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.197596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.198428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.198929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.241128 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:52.241824 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:52.249036 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.249527 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.250321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.251013 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.345724 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:52.353714 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4dc689cd-188b-4c14-9675-c6ea8b0b22fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.172042 Jun 29 16:10:52.354309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 102/193] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:52 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:52.390614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:52.398477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ce62646a-dd94-4569-8154-bcdc58299c79 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.169739 Jun 29 16:10:52.399031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 92/194] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:52 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:52.519046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:52.519654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:52.525766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.526213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.526962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:52.527397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:52.655756 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:52.663698 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9e3589e8-bb53-4d48-9ed4-c5b6ebb00029 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.148427 Jun 29 16:10:52.664305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 103/195] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:52 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:53.004275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:53.004905 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:53.010898 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.011344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.012129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.012558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.137526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:53.145930 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:53.147435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:53.148565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a2c075b4-7a2d-48b2-8dd9-67dc0a5d33bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.148174 Jun 29 16:10:53.149121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 93/196] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:52 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:53.208528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:53.209126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:53.215065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.215508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.216290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.216721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.344264 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:53.352279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c8079e0b-7746-47d5-945b-8487b622f2de tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.147543 Jun 29 16:10:53.352836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 104/197] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:53 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:53.370265 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:53.370905 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:53.377675 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.378121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.378868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.379298 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.415645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:53.416266 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:53.422701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.423668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.424119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.424550 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.529416 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:53.539101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eede16b9-4a06-4aa1-9d7d-9763644497d8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.172571 Jun 29 16:10:53.539669 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 94/198] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:53 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:53.587768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:53.597108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9b04b081-5480-4895-b6aa-4a008d62950b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.184876 Jun 29 16:10:53.598142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 105/199] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:53 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:53.681048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:53.681648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:53.687607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.688080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:53.689338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:53.689769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.092357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:54.107016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d33a7402-1540-4743-ab50-6c654d38df87 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.429719 Jun 29 16:10:54.108779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 95/200] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:53 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:54.171125 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:54.175720 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:54.191046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.191638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.192550 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.193086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.371704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:54.372951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:54.382136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.383587 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.384755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.386674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.567939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:54.579255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:54.582091 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:54.585499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-140c1be2-22d8-4957-9f25-bb3b1f1d142a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.420820 Jun 29 16:10:54.586048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 106/201] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:54 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:54.597945 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:54.598809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:54.615198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.615991 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.618475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.618922 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.841449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:54.851408 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7c8d09c2-82a3-4d54-a1fa-05d8028c3e88 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.486446 Jun 29 16:10:54.852358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 96/202] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:54 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:54.864998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:54.866220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:54.867744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:54.877290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.877443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1e790829-7b3a-42c8-8671-679947d69bb1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.287910 Jun 29 16:10:54.877737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.878004 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 107/203] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:54 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:54.878560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.878997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.929501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-90acd608-5899-478c-a4b9-9f5ec9a23b8e req-47dc7666-69d8-46e4-b0e0-9acf60b4d832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c170b82-196f-4eb1-aee4-915ea0fdbffd", "tag": "f9e596b8-8618-4cee-87b3-79b4c53159ee"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:54.942267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-90acd608-5899-478c-a4b9-9f5ec9a23b8e req-47dc7666-69d8-46e4-b0e0-9acf60b4d832 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:54.942777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-90acd608-5899-478c-a4b9-9f5ec9a23b8e req-47dc7666-69d8-46e4-b0e0-9acf60b4d832 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:54.957926 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-90acd608-5899-478c-a4b9-9f5ec9a23b8e req-47dc7666-69d8-46e4-b0e0-9acf60b4d832 service nova] Creating event network-changed:f9e596b8-8618-4cee-87b3-79b4c53159ee for instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd on hv-cinder-84814 Jun 29 16:10:54.963779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-90acd608-5899-478c-a4b9-9f5ec9a23b8e req-47dc7666-69d8-46e4-b0e0-9acf60b4d832 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040137 Jun 29 16:10:54.964818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 108/204] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:10:55.116177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:55.124105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-00f2223c-4daa-445f-b0a9-b694ee2e8c90 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.264405 Jun 29 16:10:55.124681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 97/205] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:54 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:55.126501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:55.127280 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:55.133822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.134515 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.135293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.136051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.292952 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:55.300461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a90b116c-cd71-47ad-a4cc-e9e52eab63bb req-61295315-076e-4d6c-994f-db2ae6a25091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c82fec7-271e-4a90-82ae-0425c0c53431", "tag": "7303208a-252a-4cdb-a5b7-e4a759514ef5"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:55.301371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5a35400d-cbb8-41fb-8507-7640324eec3d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.179472 Jun 29 16:10:55.302328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 109/206] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:55 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:55.318231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a90b116c-cd71-47ad-a4cc-e9e52eab63bb req-61295315-076e-4d6c-994f-db2ae6a25091 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.319264 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a90b116c-cd71-47ad-a4cc-e9e52eab63bb req-61295315-076e-4d6c-994f-db2ae6a25091 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.335441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a90b116c-cd71-47ad-a4cc-e9e52eab63bb req-61295315-076e-4d6c-994f-db2ae6a25091 service nova] Creating event network-changed:7303208a-252a-4cdb-a5b7-e4a759514ef5 for instance 6c82fec7-271e-4a90-82ae-0425c0c53431 on hv-cinder-84814 Jun 29 16:10:55.340682 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a90b116c-cd71-47ad-a4cc-e9e52eab63bb req-61295315-076e-4d6c-994f-db2ae6a25091 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056695 Jun 29 16:10:55.341540 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 98/207] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:10:55.605555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:55.607102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:55.614707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.615449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.616386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.616955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.775697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:55.785450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:55.787253 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:55.788571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0bbaa077-f895-4a27-a453-9c0a9f25b81f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.188818 Jun 29 16:10:55.789937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 110/208] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:55 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:55.806689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a8de5d60-3163-40c4-bf22-412f0aceaf64 req-b3f495bf-b608-4ee0-834f-242a8bbe1c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f66543e-7e81-4899-afc9-ce96bb61bcaa", "name": "network-vif-plugged", "status": "completed", "tag": "348e22b7-2fb7-43b6-8faa-ccc5e3b72cd9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:10:55.816263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a8de5d60-3163-40c4-bf22-412f0aceaf64 req-b3f495bf-b608-4ee0-834f-242a8bbe1c37 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.817192 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a8de5d60-3163-40c4-bf22-412f0aceaf64 req-b3f495bf-b608-4ee0-834f-242a8bbe1c37 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.834284 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a8de5d60-3163-40c4-bf22-412f0aceaf64 req-b3f495bf-b608-4ee0-834f-242a8bbe1c37 service nova] Creating event network-vif-plugged:348e22b7-2fb7-43b6-8faa-ccc5e3b72cd9 for instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa on hv-cinder-84814 Jun 29 16:10:55.839494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a8de5d60-3163-40c4-bf22-412f0aceaf64 req-b3f495bf-b608-4ee0-834f-242a8bbe1c37 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115884 Jun 29 16:10:55.844226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 99/209] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:10:55.870997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:55.871965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:55.879361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.880067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.881101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.881543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.896680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:55.897629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:55.905709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.906557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:55.907465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:55.908013 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.102103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.111699 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b29551d-9511-4cad-a319-a7050bd31588 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.220123 Jun 29 16:10:56.122277 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 100/210] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:55 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:56.134171 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.142414 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-713138a5-e9ef-4dd2-90ed-b5d687743d39 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.276994 Jun 29 16:10:56.143190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 111/211] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:55 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:56.148210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:56.150497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:56.164987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:56.165508 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.166411 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:56.166947 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.321728 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:56.322361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:56.328645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:56.329331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.330187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.330323 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:56.330651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.337541 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aac096d5-78d0-4803-bba5-f85f8be968e2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.200748 Jun 29 16:10:56.338105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 101/212] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:56 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:56.472284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.479644 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a6b28058-5bfe-4284-a144-5e9cfbbd30b0 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.161785 Jun 29 16:10:56.480227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 112/213] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:56 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:56.806744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:56.807384 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:56.813537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:56.813982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.814730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:56.815161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:56.946806 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.955212 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.956734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:56.958046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3375cd7d-158f-4306-ba36-71d31ff08780 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.155258 Jun 29 16:10:56.958611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 102/214] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:56 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:57.129249 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:57.129853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:57.135871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.136318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.137061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.137487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.158522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:57.159426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:57.165608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.166133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.166977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.167503 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.278924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:57.289674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-588ca9ed-869d-4e83-bba5-6fa459d4d248 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.163671 Jun 29 16:10:57.303144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 113/215] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:57 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:57.318097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:57.325558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-074b56f8-b7b4-4183-a83d-a8777eb6b917 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.171017 Jun 29 16:10:57.326125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 103/216] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:57 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:57.356443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:57.357039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:57.363782 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.364301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.365343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.365784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.496025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:57.497457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:57.498059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:57.504231 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-eca70579-3344-4f36-ab1e-f60bd75cd948 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.153406 Jun 29 16:10:57.505956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.507610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 114/217] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:57 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:57.508015 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.508862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.509309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.513639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:57.635383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:57.644477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1a2fe094-82e3-4f7c-9551-aa711b585626 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.151180 Jun 29 16:10:57.645105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 104/218] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:57 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:57.976264 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:57.976778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:57.982821 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.983264 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:57.984061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:57.984491 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.111143 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.119073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.120610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.121972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6221796e-df12-4f57-ab17-e82c76ef7c3d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.149798 Jun 29 16:10:58.122520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 115/219] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:57 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:58.309876 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:58.310485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:58.317012 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.317457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.318212 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.318646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.342129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:58.342736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:58.348675 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.349122 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.349883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.350317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.464927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.472162 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc3d770d-8011-4dab-8a04-330a72a0f5e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.166056 Jun 29 16:10:58.472714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 105/220] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:58 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:58.486399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.493651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-97148b32-a3f8-47eb-b804-22ff69e88091 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.155271 Jun 29 16:10:58.494206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 116/221] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:58 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:58.520366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:58.520961 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:58.526833 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.527267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.528031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.528456 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.659312 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.662099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:58.662703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:58.666830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-87638bf2-031b-41e4-8b5a-8862b735bb54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.150111 Jun 29 16:10:58.667390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 106/222] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:58 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:58.668925 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.669430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.670179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:58.670602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:58.964021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:58.971979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e7812c0a-e7a1-475b-9174-a15db35326e4 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.313646 Jun 29 16:10:58.972543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 117/223] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:58 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:59.140206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:59.140750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:59.146757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.147200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.147974 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.148403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.279645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:59.287431 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:59.288963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:59.290046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c575eb01-beba-4152-b45b-4b9477f9e940 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.153836 Jun 29 16:10:59.290596 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 107/224] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:10:59 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:10:59.489340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:59.489942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:59.495955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.496651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.497390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.497810 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.512557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:59.513706 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:59.519608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.520090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.520844 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.521272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.624051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:59.627933 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:59.632960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ddd25baa-bc47-471e-b3df-427ffecd1d71 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.147940 Jun 29 16:10:59.633532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 118/225] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:59 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:59.658084 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:59.665480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-70da412b-245c-40ec-ac5b-6244a49c3987 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.156704 Jun 29 16:10:59.666056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 108/226] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:59 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:10:59.683883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:59.684430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:59.690593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.691038 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.691789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.692246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.819769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:10:59.827245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6be15ecb-26a5-4396-a484-32cbaa77e703 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.147211 Jun 29 16:10:59.828131 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 119/227] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:59 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:10:59.988956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:10:59.989707 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:10:59.995764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.996495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:10:59.997279 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:10:59.997892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.125236 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.133570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9fd524a8-3d7a-42f8-a230-bf44c7a3b592 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.148600 Jun 29 16:11:00.134137 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 109/228] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:10:59 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:00.307440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:00.308082 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:00.314667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.315102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.315896 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.316326 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.446202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.454864 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.456380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.457466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-86517c30-8f81-4b31-96cc-94fe2e585759 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.153927 Jun 29 16:11:00.458024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 120/229] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:00 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:00.649526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:00.650052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:00.656006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.656445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.657188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.657610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.682206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:00.682816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:00.689470 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.689915 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.690667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.691098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.787082 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.794518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1bf5342a-42ab-475f-953a-edfe30e4fa39 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.148874 Jun 29 16:11:00.795455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 110/230] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:00 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:00.817848 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.825198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dda49e2d-0834-4fc7-b467-1cf515b64ce5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.146735 Jun 29 16:11:00.825747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 121/231] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:00 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:00.845050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:00.845681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:00.851655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.852131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.852881 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:00.853308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:00.978358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:00.986234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-908a20f5-f9d0-49f1-b996-bc36263c700f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.145437 Jun 29 16:11:00.986796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 111/232] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:00 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:01.150582 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:01.151176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:01.157981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.158418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.159158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.159580 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.286354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:01.295227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1aa51cd6-3aa6-420e-a5db-84be2ff5a084 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.148523 Jun 29 16:11:01.295791 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 122/233] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:01 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:01.475468 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:01.476094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:01.482176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.482614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.483368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.483791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.612888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:01.620657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:01.622406 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:01.623474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-08ecb291-1739-4556-b972-f0a62c1c658b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.151852 Jun 29 16:11:01.624048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 112/234] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:01 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:01.811712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:01.812263 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:01.818712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.819148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.819910 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.820337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.841578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:01.842187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:01.848201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.848639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.849391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:01.849821 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:01.950733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:01.960391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d55fdabb-551b-415c-9f9b-77b4ec7a2039 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.152161 Jun 29 16:11:01.961245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 123/235] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:01 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:01.987316 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:01.994701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f9204257-d665-4f75-8211-45151e0f8369 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.157033 Jun 29 16:11:01.995252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 113/236] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:01 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:02.003000 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:02.003601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:02.009598 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.010045 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.010791 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.011221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.138398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:02.145748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4f2c22e6-ef46-4b93-a3c1-c7c0412a9d63 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.147079 Jun 29 16:11:02.146305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 124/237] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:01 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:02.311555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:02.312201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:02.318766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.319201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.319975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.320406 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.453967 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:02.461401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-18ec7680-5350-4956-b2d5-ce17e2944c92 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.153717 Jun 29 16:11:02.462172 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 114/238] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:02 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:02.640825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:02.641661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:02.654886 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.655427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.656232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.656672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.785523 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:02.793360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:02.794859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:02.795976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-22345f15-0cde-4a3d-9e95-5a7f6f0fae33 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.158967 Jun 29 16:11:02.796532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 125/239] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:02 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:02.977572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:02.978110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:02.984188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.984632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:02.985383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:02.985858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.011970 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:03.012687 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:03.019332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.019877 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.020637 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.021069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.117401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.125087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a762e5f0-b273-4dce-8617-954a10f4569e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.151403 Jun 29 16:11:03.126234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 115/240] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:02 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:03.152747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.160511 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-863b77a2-d11c-432c-9e8a-d1152fa29031 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.152323 Jun 29 16:11:03.161073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 126/241] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:03 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:03.162247 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:03.162857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:03.168836 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.169282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.170034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.170469 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.293883 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.301180 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-764740c1-6d96-4441-9b8b-5ef4227ff2e1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.142676 Jun 29 16:11:03.301737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 116/242] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:03 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:03.478496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:03.479099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:03.482001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:03.486343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.486780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.487522 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.487984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.613927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.621308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5a4b4386-ec14-47cb-a360-84ae535a78df tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.146734 Jun 29 16:11:03.622112 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 127/243] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:03 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:03.814484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:03.815011 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:03.821074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.821513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.822256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:03.822680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:03.954168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.961982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.963483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:03.964590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f9280e8-be94-4a14-91f1-28b2aea747bc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.154712 Jun 29 16:11:03.965148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 117/244] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:03 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:04.142293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:04.142890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:04.148874 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.149313 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.150232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.150663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.177288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:04.177997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:04.184131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.184571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.185344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.185763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.278056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:04.286116 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-be6a2612-4938-4a5f-8f4d-78a61b4c14f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.147615 Jun 29 16:11:04.286677 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 128/245] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:04 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:04.314234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:04.318260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:04.318861 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:04.321636 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3319e008-69d0-4358-b684-ef8bfcd0d4a7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.148711 Jun 29 16:11:04.322366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 118/246] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:04 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:04.325561 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.326007 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.326758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.327185 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.455718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:04.463192 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4479f3d7-e3c4-4022-812d-af9ae5409589 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.148636 Jun 29 16:11:04.463761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 129/247] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:04 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:04.638185 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:04.638784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:04.645563 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.645995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.646737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.647158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.773575 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:04.781022 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fd7cc0d-81cd-4908-9ea5-1c5e148c8a33 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.146584 Jun 29 16:11:04.781564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 119/248] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:04 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:04.982708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:04.983417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:04.989954 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.990385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:04.991121 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:04.991543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.116310 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.124340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.126461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.127538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a1f1ea9c-5e1b-4e94-8049-3ffe5b85dd72 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.148761 Jun 29 16:11:05.128110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 130/249] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:04 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:05.303042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:05.303578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:05.309479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.309911 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.310649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.311070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.338690 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:05.339282 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:05.345932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.346472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.347339 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.347916 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.443573 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.447110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:05.454351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3f676230-c306-401d-80d8-fe5a771128da tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.155225 Jun 29 16:11:05.455526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 120/250] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:05 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:05.481420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:05.482160 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:05.484383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.489551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.490726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.491738 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.492253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.493712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0ff8408f-e1cb-4bfe-975f-4183e57e036f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.158687 Jun 29 16:11:05.495859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 131/251] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:05 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:05.624590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.631975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54f05a04-6ef6-42ef-aff2-d4a2144f198f tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.155284 Jun 29 16:11:05.632535 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 121/252] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:05 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:05.797708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:05.798303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:05.804266 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.804725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.805466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:05.805890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:05.931759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:05.939350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-098aab0f-48ce-42cd-b6aa-d059d2210527 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.145498 Jun 29 16:11:05.939924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 132/253] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:05 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:06.146211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:06.146753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:06.152859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.153299 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.154047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.154474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.280244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:06.288090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:06.289597 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:06.290676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8601d5e2-87b8-40d8-a368-4ecdf6aa6568 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.149018 Jun 29 16:11:06.291229 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 122/254] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:06 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:06.470571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:06.471175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:06.477315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.477748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.478485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.478907 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.510983 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:06.511580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:06.517594 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.518038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.518786 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.519215 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.611348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:06.619078 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-553ad129-d3e1-4b91-a01d-40e417c1ef19 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.152423 Jun 29 16:11:06.620145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 133/255] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:06 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:06.646924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:06.648398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:06.649008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:06.654497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2e139dfa-48b5-4cb3-b2f2-e6b9beb34741 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.147302 Jun 29 16:11:06.654966 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.655079 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 123/256] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:06 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:06.655488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.656355 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.656815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.786975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:06.794302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-78405add-2e3c-4100-8d4a-14c744f05a97 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.149660 Jun 29 16:11:06.794860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 134/257] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:06 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:06.956795 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:06.957399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:06.960411 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:06.964700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.965144 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:06.965889 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:06.966317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.096730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.104007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d0197957-928a-4cc6-bde9-365b1029077c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.151620 Jun 29 16:11:07.104563 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 124/258] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:06 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:07.307435 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:07.308006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:07.314681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.315115 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.315872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.316295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.333455 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:07.441300 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.449081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.450567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.451645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-424c5a9a-6efa-4893-99a4-8259fccca00c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.148230 Jun 29 16:11:07.452218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 135/259] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:07 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:07.640092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:07.640699 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:07.648241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.648736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.649495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.649923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.670614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:07.671335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:07.677948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.678385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.679124 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.679544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.779846 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.787707 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0cd00a6e-4db6-4e5e-b96d-2284675aed89 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.151449 Jun 29 16:11:07.788294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 125/260] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:07 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:07.811372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:07.811999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:07.815246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.817976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.818421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.819168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:07.819616 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:07.822845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-47a178f6-7c15-456a-9f82-9f7603626f80 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.156041 Jun 29 16:11:07.823411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 136/261] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:07 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:07.958101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:07.965532 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c3f429c0-88ae-409e-998a-12f2fd61513d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.157863 Jun 29 16:11:07.966090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 126/262] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:07 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:08.051177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-602c5725-c430-4eea-9a7e-3ccc1d334b02 req-21619871-b3e8-4a14-9b18-e8b698a481e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf0d9bb-22cd-43e2-a70c-ea778282a1d7", "name": "network-vif-plugged", "status": "completed", "tag": "fb153181-1b50-4fe4-af4b-8c992e6820af"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:08.059478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-602c5725-c430-4eea-9a7e-3ccc1d334b02 req-21619871-b3e8-4a14-9b18-e8b698a481e2 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.059954 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-602c5725-c430-4eea-9a7e-3ccc1d334b02 req-21619871-b3e8-4a14-9b18-e8b698a481e2 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.073257 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-602c5725-c430-4eea-9a7e-3ccc1d334b02 req-21619871-b3e8-4a14-9b18-e8b698a481e2 service nova] Creating event network-vif-plugged:fb153181-1b50-4fe4-af4b-8c992e6820af for instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 on hv-cinder-84814 Jun 29 16:11:08.082678 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-602c5725-c430-4eea-9a7e-3ccc1d334b02 req-21619871-b3e8-4a14-9b18-e8b698a481e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Jun 29 16:11:08.083586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 137/263] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:11:08.120834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:08.121691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:08.127609 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.128081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.128826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.129252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.255620 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:08.262892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5d84521d-f64f-4066-8df5-a6ed041eb9ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.146011 Jun 29 16:11:08.263463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 127/264] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:08 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:08.469548 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:08.470158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:08.476707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.477147 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.477892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.478320 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.616558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:08.624708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:08.626203 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:08.627814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7b932e32-1382-45c9-b22d-020d56f0069b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.162094 Jun 29 16:11:08.647146 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 138/265] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:08 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:08.805985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:08.806629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:08.813899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.814342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.815798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.816479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.840408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:08.840408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:08.846345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.846921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.847901 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:08.848495 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:08.986524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:08.997539 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a803d3b-69af-47b6-a1e7-aa277ff155f4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.195039 Jun 29 16:11:09.008243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 128/266] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:08 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:09.014019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:09.014629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:09.022091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:09.022545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:09.023336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:09.023800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:09.067952 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:09.080750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d1a5fabe-b1cf-4130-9193-591d4a0012bf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.245974 Jun 29 16:11:09.091866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 139/267] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:08 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:09.286794 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:09.287700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:09.296662 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:09.297111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:09.297883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:09.298315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:09.351872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:09.364308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-add3f0ad-7bb8-44af-bcb5-18641ee6894d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.354839 Jun 29 16:11:09.367807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 129/268] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:09 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:09.647595 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:09.649506 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:09.658529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:09.660688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:09.662587 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:09.663244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:09.764381 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:09.774011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cb020707-fbed-48f2-a71e-a0fc8c5c4178 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.497498 Jun 29 16:11:09.774517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 140/269] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:09 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:10.019331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:10.022035 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:10.036680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.039057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.039988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.040919 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.173486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.181838 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.183363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.184524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bef32465-76c6-47d5-8e55-efec55bcf8d2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.543547 Jun 29 16:11:10.185079 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 130/270] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:09 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:10.189370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:10.190514 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:10.198204 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.198724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.200215 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.200654 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.265713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.277111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ceff3645-bbbb-4d65-a201-bfc8aa695bc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.264410 Jun 29 16:11:10.293485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 141/271] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:10 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:10.373715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.384872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:10.385106 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7be57c39-2d7a-442b-8356-9db9d8e19441 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.197593 Jun 29 16:11:10.385676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:10.385868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 131/272] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:10 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:10.392120 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.392792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.393638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.394152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.607319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.633452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6bde8c66-13de-4665-9730-b013e4df5137 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.252955 Jun 29 16:11:10.634033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 142/273] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:10 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:10.790946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:10.791473 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:10.797378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.797805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.798551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:10.799841 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:10.950611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:10.959309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-19d41e49-172a-438d-a15c-111cc3aed0fe tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.172164 Jun 29 16:11:10.960484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 132/274] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:10 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:11.202813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:11.203408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:11.210088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.210523 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.211271 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.211692 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.293625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:11.294634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:11.301839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.302287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.303442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.304069 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.352272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:11.360679 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:11.362238 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:11.363373 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ab229516-a269-4143-bb7e-e33c1f9c187a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.164650 Jun 29 16:11:11.363942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 143/275] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:11 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:11.401813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:11.402418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:11.408956 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.408956 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.409707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.410132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.463525 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:11.471518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6cde1f9a-ce21-4bd2-b515-f7b15175248d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.183844 Jun 29 16:11:11.472135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 133/276] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:11 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:11.563142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:11.571572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-29ebdfd4-2bce-4e53-86d7-eb2bad0023cb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.173508 Jun 29 16:11:11.572438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 144/277] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:11 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:11.650075 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:11.650769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:11.657037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.657794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.658817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.659196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.825490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:11.833486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ea2ba987-4660-4602-b0d1-899069fdc833 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.187212 Jun 29 16:11:11.834052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 134/278] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:11 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:11.977280 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:11.977887 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:11.984986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.985576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:11.986589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:11.987546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.179945 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:12.188617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b45af291-f95b-40c2-9b96-3fd6bce4d3de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.215354 Jun 29 16:11:12.189688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 145/279] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:11 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:12.250562 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-513de740-45c3-4c7d-a4ea-14fdcc9c44b0 req-3f452cf2-54fc-47ec-a5fa-8e7c15830225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd", "name": "network-vif-plugged", "status": "completed", "tag": "8c5430ef-08ce-4e09-b34f-53198b507833"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:12.268813 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-513de740-45c3-4c7d-a4ea-14fdcc9c44b0 req-3f452cf2-54fc-47ec-a5fa-8e7c15830225 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.269257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-513de740-45c3-4c7d-a4ea-14fdcc9c44b0 req-3f452cf2-54fc-47ec-a5fa-8e7c15830225 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.292145 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-513de740-45c3-4c7d-a4ea-14fdcc9c44b0 req-3f452cf2-54fc-47ec-a5fa-8e7c15830225 service nova] Creating event network-vif-plugged:8c5430ef-08ce-4e09-b34f-53198b507833 for instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd on hv-cinder-84814 Jun 29 16:11:12.301230 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-513de740-45c3-4c7d-a4ea-14fdcc9c44b0 req-3f452cf2-54fc-47ec-a5fa-8e7c15830225 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056309 Jun 29 16:11:12.302871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 135/280] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:12.383122 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:12.383739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:12.390013 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.390534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.391421 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.391960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.489334 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:12.490111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:12.500687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.501529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.502760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.504068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.554309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:12.566709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:12.568648 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:12.570089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b0f0a985-1176-43da-8915-5b58ec79c964 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.191292 Jun 29 16:11:12.571047 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 146/281] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:12 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:12.589568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:12.590572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:12.598362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.598813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.599587 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.600052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.697382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:12.706302 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b81127f1-2b9e-4515-b83a-567e95748423 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.220862 Jun 29 16:11:12.706764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 136/282] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:12 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:12.799667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:12.809149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-efba9767-8b46-4987-a0f4-7e38cdd587ee tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.224165 Jun 29 16:11:12.810295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 147/283] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:12 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:12.852290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:12.853591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:12.859941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.861270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:12.862296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:12.862923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.010006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:13.019114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-de179c44-d842-4bfb-90b7-59302e134a58 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.172095 Jun 29 16:11:13.019779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 137/284] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:12 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:13.206396 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:13.207003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:13.213202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.213657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.214510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.214944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.384809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:13.392786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1cc0c5d1-c516-48e3-9a9e-eba7ffda4bcc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.190833 Jun 29 16:11:13.393574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 148/285] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:13 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:13.588779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:13.590373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:13.601291 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.602188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.603395 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.603970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.610614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:13.724051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:13.725285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:13.733968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.742822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.743848 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.745383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.830201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:13.840597 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:13.845179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:13.847008 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-06cd0a1d-a977-4d38-b58c-fa4cd6b75ca8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.262435 Jun 29 16:11:13.849203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 138/286] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:13 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:13.854224 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:13.855037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:13.865625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.866303 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.867398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:13.868019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:13.958790 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:13.969881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-905eccdd-9fc0-41e3-a4c2-66d14fd397c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.250427 Jun 29 16:11:13.970823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 149/287] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:13 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:14.038838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:14.039456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:14.051340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:14.052166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:14.053578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:14.054191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:14.127148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:14.143948 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-beb42eef-cb9d-4732-b748-c9204a2fcc8b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.291917 Jun 29 16:11:14.145632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 139/288] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:13 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:14.409876 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:14.410726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:14.419255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:14.419710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:14.423752 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:14.424258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:14.500938 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:14.520618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8df8b7a5-013a-4f84-b1fd-43d66b816ff2 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.483557 Jun 29 16:11:14.532073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 150/289] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:14 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:14.733174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:14.742349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ec0c096-7820-449f-b517-f14d687baa28 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.336354 Jun 29 16:11:14.753085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 140/290] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:14 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:14.865449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:14.866179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:14.874467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:14.876015 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:14.879475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:14.880839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:14.988537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:14.989437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:14.999008 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.006485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.010757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.011453 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.047370 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.059236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.061932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.063308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-02217f48-39d0-488d-b8db-04ba10e15f68 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.202245 Jun 29 16:11:15.079890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 151/291] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:14 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:15.165777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:15.167625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:15.174995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.175773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.176799 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.177425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.276098 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.288386 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-97c7f0ca-6a30-4dca-aeba-34fd669c5852 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.305337 Jun 29 16:11:15.289800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 141/292] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:14 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:15.368606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.372736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:15.380331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-813665f4-d659-4e50-af6c-d3ca0b422a19 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1321 microversion: 2.1 time: 0.221993 Jun 29 16:11:15.381141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 152/293] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:15 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:15.540977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:15.541909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:15.548446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.549306 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.550314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.550954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.763546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:15.764390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:15.774532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.775129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.776022 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:15.776793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:15.879769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.889220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-978374db-6fc9-4af6-838b-ab433f307dc5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.353053 Jun 29 16:11:15.890006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 142/294] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:15 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:15.927368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:15.935795 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0b6d8d9d-c192-489d-8671-28f2a9169d4a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.179530 Jun 29 16:11:15.936379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 153/295] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:15 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:16.087505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:16.088149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:16.094105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.094550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.095309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.095938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.234701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:16.244063 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:16.245605 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:16.246958 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a4305f95-2ce0-4e83-8b99-6583cf041c41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.163002 Jun 29 16:11:16.247876 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 143/296] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:16 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:16.312150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:16.312843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:16.319939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.320584 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.321346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.321779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.344708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-0dc9e3f1-e241-4279-8f69-fb20e3d68632 req-ab5b2334-0e05-423f-8b81-9ca321fe63f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "name": "network-vif-plugged", "status": "completed", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:16.356476 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-0dc9e3f1-e241-4279-8f69-fb20e3d68632 req-ab5b2334-0e05-423f-8b81-9ca321fe63f1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.357850 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-0dc9e3f1-e241-4279-8f69-fb20e3d68632 req-ab5b2334-0e05-423f-8b81-9ca321fe63f1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.381861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-0dc9e3f1-e241-4279-8f69-fb20e3d68632 req-ab5b2334-0e05-423f-8b81-9ca321fe63f1 service nova] Creating event network-vif-plugged:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:11:16.388512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-0dc9e3f1-e241-4279-8f69-fb20e3d68632 req-ab5b2334-0e05-423f-8b81-9ca321fe63f1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047514 Jun 29 16:11:16.389754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 144/297] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:16.399397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:16.400158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:16.408405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.409082 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.409872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.410390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.480052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:16.489892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9065a8b3-ba55-48b9-ae7e-cbef80e28511 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.185895 Jun 29 16:11:16.490913 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 154/298] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:16 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:16.571330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:16.583507 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b3590a80-c774-4b97-be63-3e29c041cd01 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1515 microversion: 2.1 time: 0.189471 Jun 29 16:11:16.584977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 145/299] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:16 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:16.602315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:16.603635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:16.610836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.611510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.613201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.616528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.688629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lazy-loading 'flavor' on Instance uuid 5f66543e-7e81-4899-afc9-ce96bb61bcaa {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:11:16.831472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8d3bea1d-6255-4159-9b7b-98ff60fa4cda tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa/action" status: 200 len: 32 microversion: 2.1 time: 0.233395 Jun 29 16:11:16.833130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 155/300] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:11:16 2022] POST /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:11:16.843636 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:16.844684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:16.856546 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.857093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.857957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.858449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.907436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:16.908169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:16.921944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.922831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:16.925338 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:16.925856 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.092248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.102966 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a1f3bc7a-43b5-4608-9233-160ca2db61e4 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.199891 Jun 29 16:11:17.103980 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 156/301] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:16 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:17.108540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:17.109406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:17.111094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.117658 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:17.118344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.119317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:17.119982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.122881 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6ab85cad-4b4e-4834-9569-2857c76217d2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.283315 Jun 29 16:11:17.123880 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 146/302] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:16 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:17.268439 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.272093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:17.273020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:17.278788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3199b8e5-f8da-47ae-a2d7-3a0ea3e3525a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.173598 Jun 29 16:11:17.279372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:17.279808 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.281007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:17.281437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.288938 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 157/303] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:17 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:17.486209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.494242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.496568 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.497965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-82abeb4e-38d3-42a8-a2d3-171a690f5062 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.236911 Jun 29 16:11:17.498509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 147/304] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:17 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:17.512968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:17.513568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:17.520291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:17.520722 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.521471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:17.521906 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:17.691077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:17.700667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-abdb7415-a1a4-4a3f-acae-eb7481612e16 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.191175 Jun 29 16:11:17.701825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 158/305] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:17 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:18.120521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:18.121972 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:18.127924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.128371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.129123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.129716 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.142293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:18.142921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:18.149377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.150008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.150755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.151502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.302247 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.310607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-21c8bc8b-904c-43c7-970b-5618f741b145 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.193923 Jun 29 16:11:18.312302 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 148/306] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:18 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:18.324035 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:18.324574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:18.331389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.332070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.332867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.333295 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.461232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.470342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1e3f3e73-39be-4408-a433-620cbf9c1a3d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.331795 Jun 29 16:11:18.480924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 159/307] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:18 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:18.482346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.490738 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0b77489-8702-4a13-8c95-9d642abf0f1d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.176740 Jun 29 16:11:18.491287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 149/308] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:18 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:18.516250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:18.516851 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:18.523964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.524410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.525157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.525590 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.658391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.667019 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.668658 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.669841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c2c8f95a-203a-4f67-9e67-18947316064a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.157440 Jun 29 16:11:18.670463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 160/309] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:18 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:18.717901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:18.718499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:18.725113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.725556 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.726304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:18.726731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:18.857415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:18.864739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a228c35-b395-4b37-87b9-7388cd806b63 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.150651 Jun 29 16:11:18.865319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 150/310] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:18 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:19.326273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:19.327459 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:19.333432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.333873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.335472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.336124 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.472392 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:19.479719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fd026660-d32b-4484-9f52-2943f8083e73 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.157304 Jun 29 16:11:19.480558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 161/311] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:19 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:19.487746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:19.488966 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:19.495040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.495551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.496401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.497079 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.508645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:19.509260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:19.515416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.515882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.516844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.517466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.633933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:19.641293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-50569749-0c59-4300-afee-d1a1eeeaa897 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.157797 Jun 29 16:11:19.641849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 151/312] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:19 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:19.661730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:19.669008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-49a861ca-68b2-487b-9be2-5507dc0fba57 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.164377 Jun 29 16:11:19.669557 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 162/313] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:19 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:19.687481 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:19.688184 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:19.694113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.694547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.695439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.695875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.824661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:19.832938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:19.834458 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:19.835548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1634a45a-cca8-437e-820c-50711925bf71 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.151958 Jun 29 16:11:19.836126 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 152/314] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:19 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:19.883084 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:19.883747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:19.889834 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.890284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:19.891043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:19.891476 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.029599 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.037906 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-616f7818-ccc7-4303-92da-a3fc5b189d5d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.158897 Jun 29 16:11:20.038460 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 163/315] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:19 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:20.497497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:20.498093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:20.504628 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.505069 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.505808 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.506232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.634860 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.642362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9906daf1-0ed8-4389-86ee-708688f5feff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.148972 Jun 29 16:11:20.643572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 153/316] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:20 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:20.657301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:20.657904 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:20.664007 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.664453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.665200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.665636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.686247 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:20.686845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:20.693268 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.693708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.694454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.694881 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.790266 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.797702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dcee8462-eab5-484e-a8ee-a58f6cca8e25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.144171 Jun 29 16:11:20.798260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 164/317] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:20 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:20.824850 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.832116 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63ad7a06-f171-4a8c-9483-7796fa54a163 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.149527 Jun 29 16:11:20.832661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 154/318] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:20 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:20.853099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:20.853700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:20.859757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.860221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.860967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:20.861391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:20.988250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.996140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.998301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:20.999500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4f0cb4eb-ec98-476a-8e92-d527292c8791 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.150222 Jun 29 16:11:21.000110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 165/319] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:20 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:21.054944 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:21.055579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:21.061498 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.061941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.062693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.063120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.082631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:21.194596 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:21.201862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58e50041-3df7-4ce0-b19b-9486c4e82d58 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.150712 Jun 29 16:11:21.202420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 155/320] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:21 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:21.660513 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:21.661106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:21.667134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.667570 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.668350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.668777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.805874 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:21.813457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e7ef9aac-a85d-4e67-b741-52d0a9c4ea2a tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.157641 Jun 29 16:11:21.814176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 166/321] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:21 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:21.814313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:21.815449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:21.821490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.821933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.822720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.823145 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.848788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:21.849651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:21.857712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.858217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.859012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:21.859436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:21.881547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:21.977933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:21.986854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4d6e13a-362b-491c-848e-496806f1a48a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.176163 Jun 29 16:11:21.987426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 156/322] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:21 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:22.014716 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:22.021298 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:22.022020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:22.023553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6fd95ee0-ba08-4b8b-8ea8-59da9236bb7e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.178480 Jun 29 16:11:22.024457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 167/323] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:21 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:22.029051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:22.029498 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:22.030276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:22.030910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:22.192337 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:22.200461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:22.201979 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:22.203087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-82422c19-f27d-489b-a64d-fda6a5e5896a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.188444 Jun 29 16:11:22.203754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 157/324] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:22 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:22.218426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:22.219158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:22.225703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:22.226170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:22.226927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:22.227352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:22.375033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:22.385934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f30ede02-f3c3-4c96-b85d-b332003f2e25 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.171438 Jun 29 16:11:22.386492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 168/325] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:22 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:22.830470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:22.831071 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:22.842195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:22.842195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:22.842195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:22.842195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:22.967129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:22.975359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9dfecfc9-9f55-4267-b1d8-d7cdc9e6202b tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.148731 Jun 29 16:11:22.975951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 158/326] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:22 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:23.003693 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:23.004419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:23.010688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.011205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.012070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.012508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.045176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:23.045927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:23.052137 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.052658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.053492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.053999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.162896 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:23.170564 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3782730e-fbdf-44a8-b91e-6d72c15a70bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.170649 Jun 29 16:11:23.171127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 169/327] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:22 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:23.199553 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:23.207850 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ba2801a8-5cb2-4be2-b7ab-c4d8aa8f807e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.166624 Jun 29 16:11:23.208484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 159/328] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:23 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:23.221753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:23.222390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:23.228624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.229060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.229812 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.230237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.361510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:23.369248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:23.370740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:23.372101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-058f12bc-2caa-4a2a-8b30-fb4937bbb5e3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.154594 Jun 29 16:11:23.372818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 170/329] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:23 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:23.402462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:23.403080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:23.409023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.409466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.410217 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:23.410644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:23.543618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:23.551007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2959129e-aec2-4ea3-96d8-a4409774348b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.152405 Jun 29 16:11:23.551561 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 160/330] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:23 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:23.992717 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:23.993319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:23.999853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.000452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.001245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.001663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.135163 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.142579 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4f8467e5-f699-4ba9-a3e4-bd4d7ce0c587 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.153859 Jun 29 16:11:24.143130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 171/331] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:23 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:24.187607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:24.188284 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:24.194329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.194780 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.195573 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.196034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.225440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:24.226048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:24.232457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.232896 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.233639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.234065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.324256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.331638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3cff25fd-77ee-4df6-9286-0b3de0f0dfb0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.147803 Jun 29 16:11:24.332390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 161/332] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:24 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:24.363588 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.370916 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a9063d2b-9fc0-4b19-b008-fc17611c68de tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.149750 Jun 29 16:11:24.371469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 172/333] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:24 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:24.390233 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:24.390763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:24.396712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.397149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.397892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.398313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.527475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.535926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.537425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.538500 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0884a042-4efd-4174-8c84-52cb91c6e703 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.152097 Jun 29 16:11:24.539049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 162/334] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:24 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:24.567508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:24.568127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:24.574083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.574521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.575259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:24.575682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:24.703906 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:24.711630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c3b49508-8ea1-40d9-93e5-c6ff61b34bf0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.148045 Jun 29 16:11:24.712209 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 173/335] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:24 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:25.159006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:25.159602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:25.165826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.166266 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.167066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.167443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.292840 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.300608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-289afdee-a53f-4b8a-9dfe-48094f546d89 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.145411 Jun 29 16:11:25.301162 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 163/336] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:25 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:25.347787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:25.348412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:25.354528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.355033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.355786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.356241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.387758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:25.388500 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:25.394518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.395029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.395778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.396232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.481871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.489998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-24a58111-c10d-44c1-bd4b-fc1884784a63 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.145980 Jun 29 16:11:25.490558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 174/337] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:25 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:25.526366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.533636 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-14a3157b-1115-49d0-b54b-4ba395f1b10c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.149715 Jun 29 16:11:25.534193 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 164/338] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:25 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:25.556134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:25.556735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:25.562699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.563142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.563908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.564337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.691259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.699123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.700651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.701737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-19269ac0-7bee-4387-a3d1-99e6b9aefc61 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.149561 Jun 29 16:11:25.702284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 175/339] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:25 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:25.728127 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:25.728725 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:25.734684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.735117 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.735874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:25.736301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:25.861588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:25.868897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-547ceffb-8779-4704-b29b-c7c9a08ec08a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.144532 Jun 29 16:11:25.869493 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 165/340] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:25 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:26.317563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:26.318163 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:26.324218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.324659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.325399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.325823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.458636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:26.465921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cb9bb985-03f1-4022-a886-d05355828564 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.152766 Jun 29 16:11:26.466466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 176/341] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:26 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:26.506653 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:26.507177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:26.513089 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.513523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.514258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.514678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.550607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:26.551212 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:26.554116 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:26.558283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.558729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.559481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.559937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.639667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:26.647129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d5c81441-4430-405d-95c7-8e7d4b9792bd tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.144274 Jun 29 16:11:26.647693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 166/342] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:26 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:26.689056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:26.696641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cfb48d26-5bb6-481b-b924-1ce4f0e83727 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.150433 Jun 29 16:11:26.697193 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 177/343] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:26 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:26.720169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:26.720767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:26.727142 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.727582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.728357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.728777 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.861166 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:26.869372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:26.871175 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:26.872633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d2a8060-3ceb-4d4a-835a-39c38d7e69c2 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.156217 Jun 29 16:11:26.873176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 167/344] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:26 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:26.886429 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:26.887030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:26.893547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.893982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:26.894879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:26.895354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.025848 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:27.034191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-39cb1e9d-cba3-433d-822e-c05012a5c3ac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.151096 Jun 29 16:11:27.034732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 178/345] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:26 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:27.482396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:27.482999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:27.489591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.490034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.490782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.491210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.614547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:27.621809 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b3446e0e-b207-4112-9d73-d3f14a23848d tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.143312 Jun 29 16:11:27.622619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 168/346] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:27 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:27.663907 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:27.664505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:27.670553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.670990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.671731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.672184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.713677 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:27.714496 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:27.720551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.720993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.721744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.722172 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.798750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:27.806841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-22990578-c706-467e-a526-b78709b1a797 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.146806 Jun 29 16:11:27.807397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 179/347] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:27 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:27.853611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:27.860867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0163017-c8a7-44b0-bf08-679020cfb746 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.151011 Jun 29 16:11:27.861417 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 169/348] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:27 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:27.889875 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:27.890562 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:27.896733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.897176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:27.897919 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:27.898341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.025549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:28.033374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:28.035394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:28.036498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3421a353-4f96-49fd-9ba9-001794104bd4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.150644 Jun 29 16:11:28.037052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 180/349] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:27 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:28.050984 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:28.051597 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:28.057559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.058006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.058763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.059200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.195691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:28.202912 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5c10b526-19bb-41f7-b526-b62302da42ff tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.156243 Jun 29 16:11:28.203521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 170/350] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:28 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:28.639182 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:28.639710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:28.646383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.646821 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.647556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.648022 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.776365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:28.783709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dcc3e4ef-6034-4a27-be2f-05daf3ffccaa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.148426 Jun 29 16:11:28.784296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 181/351] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:28 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:28.824007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:28.824603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:28.830559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.830995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.832425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.832854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.880087 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:28.880792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:28.886833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.887347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.888135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:28.888566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:28.959520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:28.966930 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45332588-6eb4-4cf5-b404-202e4c59045e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.146765 Jun 29 16:11:28.967490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 171/352] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:28 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:29.017312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:29.024680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ef2e69dd-5e70-4dc2-86cc-1037b216aa9c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.148943 Jun 29 16:11:29.025231 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 182/353] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:28 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:29.053702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:29.054302 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:29.060210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.060655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.061407 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.061839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.065708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:29.193602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:29.201730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:29.202978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:29.204095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a7b66ed1-4f6f-45d4-8c04-17dfb93e48a3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.154692 Jun 29 16:11:29.204790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 172/354] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:29 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:29.220567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:29.221459 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:29.227140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.227588 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.228406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.228842 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.372756 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:29.380692 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-24d5d908-cf09-402c-8ad9-3b007120c284 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.163810 Jun 29 16:11:29.381565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 183/355] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:29 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:29.800541 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:29.801249 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:29.807878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.808407 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.809243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.809742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.983384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:29.984025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:29.996012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.996815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:29.998199 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:29.998874 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.007335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:30.183156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.194978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5877d59d-c3aa-4aee-93c7-f8ef6612ffcd tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.397866 Jun 29 16:11:30.201030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 173/356] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:29 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:30.211262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:30.212123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:30.215872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:30.220516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:30.221343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.222341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:30.223105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.225783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.235111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9fcc7c15-5379-4a04-a702-11598e4f9cb8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.255406 Jun 29 16:11:30.246039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 184/357] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:29 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:30.254230 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:30.255169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:30.262277 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:30.263206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.264594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:30.267717 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.377681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.386394 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f7d42a9-bc6a-447b-b463-4073ad329b39 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.183413 Jun 29 16:11:30.392031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 174/358] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:30 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:30.397145 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:30.398209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:30.404756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:30.405301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.406078 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:30.406887 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:30.480537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.491589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.495996 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.499665 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ceedba43-b769-4493-8405-2196e75d88d4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.252263 Jun 29 16:11:30.500853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 185/359] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:30 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:30.573590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:30.582548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c1e0d4f4-5523-4546-9723-197b71e97c5f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.190051 Jun 29 16:11:30.583814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 175/360] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:30 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:31.212079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:31.213532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:31.223170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.226625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.231243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.233149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.254899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:31.257830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:31.272375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.274080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.275067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.275660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.395255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.407942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-22da0e0f-c9f8-4e9c-88e4-b298db69dcfa tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.198607 Jun 29 16:11:31.418166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 186/361] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:31 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:31.423961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:31.424844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:31.433060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.433513 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.434574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.435010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.455661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.466751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d0a0eb0d-cd80-4645-ad23-4d000b36491c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.217530 Jun 29 16:11:31.484454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 176/362] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:31 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:31.524459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:31.526379 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:31.534557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.535889 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.537945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.538642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.595484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.607610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-37a6eb95-0433-4a6d-91c6-07f88aa140dd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.197317 Jun 29 16:11:31.608387 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 187/363] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:31 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:31.614900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:31.615508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:31.623643 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.624189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.625266 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:31.626117 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:31.714770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.723027 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.724569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.725669 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5bcb4514-72a1-4974-bd36-9d07e28a4edf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.209464 Jun 29 16:11:31.736143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 177/364] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:31 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:11:31.769636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:31.777784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f65208e3-c224-4738-b98e-ecb8913e110e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.168427 Jun 29 16:11:31.778873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 188/365] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:31 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:32.426250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:32.426942 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:32.433524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.433999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.434769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.435203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.484747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:32.485574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:32.505434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.505867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.506709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.507144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.619492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.624607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-18459a67-2acd-482b-8240-131db74e5f54 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1314 microversion: 2.1 time: 0.202632 Jun 29 16:11:32.625176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 178/366] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:32 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:32.631154 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:32.633065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:32.639469 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.640150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.640923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.641354 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.689482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.697892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ea002dc4-d99a-40d6-98d4-beeec0229302 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.217031 Jun 29 16:11:32.709226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 189/367] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:32 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:32.743962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:32.745023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:32.753794 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.755764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.758139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.758826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.799680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.807515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-396ac214-8868-435a-abee-fe13d78e322f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.179845 Jun 29 16:11:32.809403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 179/368] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:32 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:32.816779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:32.817393 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:32.823724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.824373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.825802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:32.826693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:32.928293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.942973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.944576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.945681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-99eab388-652f-443d-a95a-0318b8793103 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.206471 Jun 29 16:11:32.946232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 190/369] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:32 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:11:32.978688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:32.986176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a97466cd-5ebd-4023-b228-43a9da31bd5e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.175579 Jun 29 16:11:32.986817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 180/370] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:32 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:33.642030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:33.642677 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:33.649383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.650638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.651460 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.651930 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.718729 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:33.719420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:33.729391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.729391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.729391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.729391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.801849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:33.809647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-da493cf8-1e6c-43a4-8ef7-83f87da5ef1e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1501 microversion: 2.1 time: 0.171886 Jun 29 16:11:33.810841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 191/371] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:33 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:33.833131 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:33.833926 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:33.840630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.841086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.841890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.842579 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.882066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:33.889435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1f74106a-369b-4a25-b883-9179f568ab62 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.175703 Jun 29 16:11:33.889995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 181/372] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:33 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:33.962945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:33.963689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:33.971107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.971558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:33.972346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:33.975207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:34.009899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:34.019313 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-35a625ca-cdd8-44fa-a36f-54220c600378 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.189499 Jun 29 16:11:34.029754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 192/373] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:33 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:34.029754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:34.029754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:34.039399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:34.043972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:34.044953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:34.046288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:34.179841 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:34.193203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:34.199661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:34.201799 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3d8099a-23e7-403f-bdb1-bf5838d17b86 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.242638 Jun 29 16:11:34.203038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 182/374] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:33 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:34.239070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:34.255909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1510151a-0a3c-4343-9a67-637eb5aa5636 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.234383 Jun 29 16:11:34.256486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 193/375] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:34 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:34.905811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:34.906478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:34.919370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:34.919851 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:34.920581 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:34.921004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.036860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:35.037537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:35.044262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.044869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.045927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.046428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.052574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:35.063104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ce4bf44c-1c7a-4897-b275-5cf2b6184bb3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.161012 Jun 29 16:11:35.064254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 183/376] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:34 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:35.178839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:35.186158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-27756621-f314-4489-bcc8-b4ffb0be261b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.153656 Jun 29 16:11:35.186708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 194/377] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:35 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:35.223488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:35.224125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:35.230032 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.230471 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.231215 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.231641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.272992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:35.273597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:35.279510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.279990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.280742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.281171 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.367981 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:35.378399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:35.380296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:35.381892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa39196e-4e3b-4858-9d04-43ec3002d300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.162179 Jun 29 16:11:35.382586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 184/378] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:35 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:35.397165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc30ea42-2e16-4005-bfa7-b00b93f2d0bd"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:35.398452 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:35.405970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.406704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.407470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.408108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.441273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:35.449276 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f60265b6-9557-4af3-8c0a-7f8d10c7ebf6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.180140 Jun 29 16:11:35.450456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 195/379] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:35 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:35.519313 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-431386f4-e84d-41a6-ab57-557b2c7d226d req-92e050bd-50c2-43c6-a73d-a9f09b366a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c170b82-196f-4eb1-aee4-915ea0fdbffd", "name": "network-vif-plugged", "status": "completed", "tag": "f9e596b8-8618-4cee-87b3-79b4c53159ee"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:35.528066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-431386f4-e84d-41a6-ab57-557b2c7d226d req-92e050bd-50c2-43c6-a73d-a9f09b366a4e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:35.528559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-431386f4-e84d-41a6-ab57-557b2c7d226d req-92e050bd-50c2-43c6-a73d-a9f09b366a4e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:35.542960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-431386f4-e84d-41a6-ab57-557b2c7d226d req-92e050bd-50c2-43c6-a73d-a9f09b366a4e service nova] Creating event network-vif-plugged:f9e596b8-8618-4cee-87b3-79b4c53159ee for instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd on hv-cinder-84814 Jun 29 16:11:35.552633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-431386f4-e84d-41a6-ab57-557b2c7d226d req-92e050bd-50c2-43c6-a73d-a9f09b366a4e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Jun 29 16:11:35.553235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 196/380] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:11:36.081352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:36.083497 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:36.090229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.090674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.091431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.091884 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.227614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:36.235042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4b76079b-4118-447d-9c2b-1848123c85db tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.157952 Jun 29 16:11:36.235595 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 197/381] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:36 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:36.239924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:36.240607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:36.246437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.246887 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.247947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.248376 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.377586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:36.385567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-83088b1b-2484-40de-ad32-ac04097e919e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.148954 Jun 29 16:11:36.386139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 198/382] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:36 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:36.400379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:36.400978 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:36.406959 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.407413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.408485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.408922 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.538485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:36.546388 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:36.547911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:36.549452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a9143905-290a-4bdd-aaa5-81c895295158 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.152317 Jun 29 16:11:36.550002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 199/383] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:36 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:11:36.554866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:36.555488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:36.561241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.561684 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.562427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:36.562859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:36.694985 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:36.702426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-01fa0c58-9bc0-4979-87df-0778b0bd4f9c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.150945 Jun 29 16:11:36.703183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 200/384] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:36 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:37.257488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:37.260394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:37.276571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.277523 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.278514 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.279157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.300540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:37.429697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:37.449148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-85d0dbf5-3e37-434c-8649-402becd08c7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.201965 Jun 29 16:11:37.451169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 201/385] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:37 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:37.463383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:37.465658 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:37.475506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.478623 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.479709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.479909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.631311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:37.639515 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9e217b05-8d7d-4f97-ba8d-ed7a5b2494c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.185887 Jun 29 16:11:37.640126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 202/386] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:37 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:37.645960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:37.646576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:37.656225 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.656759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.657051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-27ee28ca-21de-47d5-861a-0d7d536b48b8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "POST /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.263755 Jun 29 16:11:37.657528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.657691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 185/387] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:11:35 2022] POST /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd/os-volume_attachments => generated 194 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:37.657832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.719779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:37.720733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:37.727383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.727878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.728646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:37.729079 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:37.791033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:37.800725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:37.802871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:37.804110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-536f42cb-c7a3-43a3-bbba-b10378bfdaf0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.162893 Jun 29 16:11:37.804750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 203/388] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:37 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:37.968179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:37.976772 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-be2d6892-222c-48d1-87a6-52bff14e30a7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.261414 Jun 29 16:11:37.977352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 186/389] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:37 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:38.468786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:38.469440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:38.475602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:38.476091 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:38.476850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:38.477314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:38.616630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:38.624566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c4fc4cb9-4d22-4a2c-98f3-59a6a9d339c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.159641 Jun 29 16:11:38.625128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 204/390] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:38 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:38.658234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:38.658765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:38.665851 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:38.666349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:38.667100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:38.667528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:38.688953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:38.804499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:38.813203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-39edc157-4922-400e-926a-ef4b1e136643 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.158392 Jun 29 16:11:38.813203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 187/391] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:38 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:38.827510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:38.828084 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:38.834451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:38.834888 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:38.835635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:38.836093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:38.966301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:38.975302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:38.976820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:38.977919 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-550bf8ed-67f5-4c90-915e-11530d649c8a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1407 microversion: 2.20 time: 0.154618 Jun 29 16:11:38.978468 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 205/392] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:38 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:38.993758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:38.994371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:39.000681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.001127 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.001887 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.002318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.142638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:39.150814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fea69b67-0793-4174-b11e-e482d3a61e2c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.160839 Jun 29 16:11:39.151373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 188/393] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:38 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:39.644839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:39.645535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:39.655055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.655501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.656322 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.656740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.830348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:39.830950 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:39.839688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.843230 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.844074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.844510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.936538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:39.947380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1dfcd4f8-2a19-49cc-9804-db6f4c233269 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.307337 Jun 29 16:11:39.948543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 206/394] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:39 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:39.956016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-ad20e448-7b9f-4fa9-b41d-0f8ce167456e req-2f8ce80a-f865-45da-ad15-90591fea7137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c82fec7-271e-4a90-82ae-0425c0c53431", "name": "network-vif-plugged", "status": "completed", "tag": "7303208a-252a-4cdb-a5b7-e4a759514ef5"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:39.973462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-ad20e448-7b9f-4fa9-b41d-0f8ce167456e req-2f8ce80a-f865-45da-ad15-90591fea7137 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:39.974156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-ad20e448-7b9f-4fa9-b41d-0f8ce167456e req-2f8ce80a-f865-45da-ad15-90591fea7137 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:39.990043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-ad20e448-7b9f-4fa9-b41d-0f8ce167456e req-2f8ce80a-f865-45da-ad15-90591fea7137 service nova] Creating event network-vif-plugged:7303208a-252a-4cdb-a5b7-e4a759514ef5 for instance 6c82fec7-271e-4a90-82ae-0425c0c53431 on hv-cinder-84814 Jun 29 16:11:39.995135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-ad20e448-7b9f-4fa9-b41d-0f8ce167456e req-2f8ce80a-f865-45da-ad15-90591fea7137 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044539 Jun 29 16:11:39.996009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 207/395] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:40.001909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:40.002866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:40.010701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.011379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.012167 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.012760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.019675 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:40.028611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-36eb952a-0ea0-4272-bf4c-30d5da78a3a3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.201976 Jun 29 16:11:40.029547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 189/396] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:39 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:40.147540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:40.156461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:40.158176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:40.159135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-da8a6b27-ac0d-4198-82c5-e61a58f046bb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1599 microversion: 2.20 time: 0.161900 Jun 29 16:11:40.159673 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 208/397] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:11:39 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:11:40.178315 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:40.178942 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:40.179670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:40.180200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:40.186299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.186993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.187757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.187972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.188412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.188527 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.189199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.189626 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.279353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a44951fd-a959-4801-9daa-d188b0fc1c30 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105335 Jun 29 16:11:40.279964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 209/398] 10.222.0.47 () {60 vars in 1315 bytes} [Wed Jun 29 16:11:40 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:11:40.592566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:40.602987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-72e0a773-4b86-455c-9a74-a40f2cf67531 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1367 microversion: 2.1 time: 0.433100 Jun 29 16:11:40.612665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 190/399] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:40 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:40.964208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:40.965063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:40.971040 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.971925 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:40.973479 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:40.974244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.045502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:41.046686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:41.053867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:41.054190 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.054943 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:41.055375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.211556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:41.220463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c343546c-65e0-4dd8-8e43-737b6566b0c1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.260096 Jun 29 16:11:41.221503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 210/400] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:40 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:41.619569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:41.620343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:41.625126 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:41.626952 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:41.627475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.628363 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:41.631350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.633916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a5009d09-f4fb-4e6c-956b-c93a0604be56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.592266 Jun 29 16:11:41.635128 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 191/401] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:41 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:41.775666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:41.787367 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-21de8025-87f2-4271-bbcc-5bfb08033607 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1557 microversion: 2.1 time: 0.171413 Jun 29 16:11:41.788080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 211/402] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:41 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:41.804904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:41.805111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:41.811763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:41.812438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.813341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:41.814040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:41.945383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5d2199f7-eeb6-49d1-ab3b-b3ba3445a898 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145029 Jun 29 16:11:41.945917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 192/403] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:11:41 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:42.167095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-d2f3cea6-a04d-4fe0-bd80-c8276e883bec req-e6bf797c-3fd4-43d4-b97e-680eeb9a2209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:42.179996 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-d2f3cea6-a04d-4fe0-bd80-c8276e883bec req-e6bf797c-3fd4-43d4-b97e-680eeb9a2209 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:42.181103 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-d2f3cea6-a04d-4fe0-bd80-c8276e883bec req-e6bf797c-3fd4-43d4-b97e-680eeb9a2209 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:42.196797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-d2f3cea6-a04d-4fe0-bd80-c8276e883bec req-e6bf797c-3fd4-43d4-b97e-680eeb9a2209 service nova] Creating event network-changed:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:11:42.202690 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-d2f3cea6-a04d-4fe0-bd80-c8276e883bec req-e6bf797c-3fd4-43d4-b97e-680eeb9a2209 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042486 Jun 29 16:11:42.204064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 212/404] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:42.240902 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:42.242658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:42.251475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:42.252730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:42.254160 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:42.254857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:42.651344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:42.652471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:42.655182 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:42.659413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:42.660492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:42.661422 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:42.662006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:42.666679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79160876-e8af-4b48-a0c7-d4762f1dc209 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.432008 Jun 29 16:11:42.668490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 193/405] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:42 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:42.827647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:42.836977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d40f3d5b-978c-4ae1-ad0a-ccce3a751b5c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.189637 Jun 29 16:11:42.837649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 213/406] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:42 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:11:43.684365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:43.684978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:43.691674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:43.692153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:43.692920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:43.693350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:43.824868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:43.832660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-300c24ec-503c-4e11-b6c9-0d4e9d5b0b07 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.152141 Jun 29 16:11:43.842136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 194/407] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:43 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:43.854412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:43.855021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:43.861262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:43.861710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:43.862482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:43.863472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:43.995079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:44.002692 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d6269721-1b67-4fef-ada1-d5a4a190e9cf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.152204 Jun 29 16:11:44.003257 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 214/408] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:43 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:44.298941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-c209827c-cdd7-4d04-9640-9bb9124b12c8 req-4dee6737-5d6a-4bad-98c0-a81d5acad047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c170b82-196f-4eb1-aee4-915ea0fdbffd", "tag": "f9e596b8-8618-4cee-87b3-79b4c53159ee"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:11:44.307492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c209827c-cdd7-4d04-9640-9bb9124b12c8 req-4dee6737-5d6a-4bad-98c0-a81d5acad047 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:44.308246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c209827c-cdd7-4d04-9640-9bb9124b12c8 req-4dee6737-5d6a-4bad-98c0-a81d5acad047 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:44.321522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-c209827c-cdd7-4d04-9640-9bb9124b12c8 req-4dee6737-5d6a-4bad-98c0-a81d5acad047 service nova] Creating event network-changed:f9e596b8-8618-4cee-87b3-79b4c53159ee for instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd on hv-cinder-84814 Jun 29 16:11:44.328683 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-c209827c-cdd7-4d04-9640-9bb9124b12c8 req-4dee6737-5d6a-4bad-98c0-a81d5acad047 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033351 Jun 29 16:11:44.329206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 195/409] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:11:44.849516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:44.850151 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:44.856224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:44.856789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:44.857415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:44.857878 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:44.991504 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:44.999179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-630d3d1e-5551-4bc0-973d-9635051acfeb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.153615 Jun 29 16:11:44.999739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 215/410] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:44 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:45.020170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:45.020858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:45.026967 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:45.027410 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:45.028208 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:45.028640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:45.152482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:45.160318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5500affe-7ad4-4a58-8145-16100a44788c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.144161 Jun 29 16:11:45.160869 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 196/411] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:45 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:46.016288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:46.016887 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:46.024093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:46.024539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:46.025299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:46.025722 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:46.153811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:46.161393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b2201860-e18c-491b-86c2-12e463ca1d11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.148882 Jun 29 16:11:46.161962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 216/412] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:46 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:46.177304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:46.177909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:46.184370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:46.184814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:46.185570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:46.186015 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:46.327091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:46.334471 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-418f73c7-9cf7-401e-a4f8-61e5f50bcc56 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.161484 Jun 29 16:11:46.335025 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 197/413] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:46 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:47.177897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:47.178492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:47.184744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:47.185181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:47.185936 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:47.186358 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:47.313505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:47.321375 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e04a95f7-bfca-4658-a22d-7c1f2489aa4a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.147372 Jun 29 16:11:47.321926 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 217/414] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:47 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:47.350413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:47.351022 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:47.357890 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:47.358338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:47.359275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:47.359711 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:47.489445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:47.496830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b488e8dd-c93b-483f-94a2-1ca47be9a6da tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.150215 Jun 29 16:11:47.497681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 198/415] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:47 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:48.337986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:48.338651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:48.345011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:48.345457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:48.346213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:48.346652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:48.477410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:48.485030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8ba232f7-b8c8-4318-bb54-727ad1840a13 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.150932 Jun 29 16:11:48.485594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 218/416] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:48 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:48.514181 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:48.514790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:48.521865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:48.522306 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:48.523060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:48.523491 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:48.656717 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:48.664778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6753754e-5206-48a3-a8f7-a9501174c74d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.154365 Jun 29 16:11:48.665336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 199/417] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:48 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:49.501798 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:49.502395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:49.508993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:49.509415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:49.510154 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:49.510578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:49.639629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:49.643197 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:49.652558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b9d755b1-66a1-4826-9b64-10640524da28 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.154677 Jun 29 16:11:49.653187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 219/418] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:49 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:49.681874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:49.682469 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:49.688918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:49.689359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:49.690102 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:49.690529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:49.823317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:49.830715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cb5c374e-c8f7-4e4e-9f49-2efdf40b33e5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.152604 Jun 29 16:11:49.831271 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 200/419] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:49 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:50.668897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:50.669500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:50.676783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:50.677270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:50.678159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:50.678606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:50.812982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:50.820982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-372cb92c-1cef-4002-99eb-c27d581d0fc4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.155971 Jun 29 16:11:50.821541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 220/420] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:50 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:50.849200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:50.849799 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:50.856376 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:50.856816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:50.857566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:50.857995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:50.994634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:51.002325 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b4019db0-b82c-43ca-8833-65dbe4019de9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.159001 Jun 29 16:11:51.002877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 201/421] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:50 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:51.838190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:51.838783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:51.845134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:51.845586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:51.846346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:51.846780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:51.972612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:51.980467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-75b6f49b-12f7-4de7-84fc-f73e23a3545d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.146122 Jun 29 16:11:51.981063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 221/422] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:51 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:52.021463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:52.022019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:52.028460 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:52.028923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:52.029661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:52.030092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:52.154856 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:52.162176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-652c6925-c7ff-4c20-8aef-eb30a6c080e2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.145203 Jun 29 16:11:52.162735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 202/423] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:52 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:52.997009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:52.997855 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:53.003890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:53.004286 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:53.005055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:53.005482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:53.134264 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:53.141683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-91faba76-6c87-473a-bcb0-5cdf8302d051 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.148511 Jun 29 16:11:53.142244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 222/424] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:52 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:53.178217 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:53.178819 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:53.185272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:53.185718 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:53.186467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:53.186896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:53.312160 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:53.320086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-78e2bc53-b8b6-4051-b975-53b622118aaa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.145559 Jun 29 16:11:53.320641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 203/425] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:53 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:54.158189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:54.158787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:54.166125 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:54.166560 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:54.167333 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:54.167760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:54.295129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:54.303273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f63ba11a-ab41-40be-93de-dbbf7188e177 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.148768 Jun 29 16:11:54.303755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 223/426] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:54 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:54.336625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:54.337232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:54.343778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:54.344250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:54.345005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:54.345438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:54.474531 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:54.481953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cae129fd-e5e8-48eb-a0b1-9c2c312c38f3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.149144 Jun 29 16:11:54.482509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 204/427] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:54 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:55.320669 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:55.321295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:55.327330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:55.327772 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:55.328547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:55.328983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:55.451959 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:55.460295 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-25ca2388-8011-4152-a68f-8f1448f3d2c6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.144078 Jun 29 16:11:55.460859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 224/428] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:55 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:55.498588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:55.499193 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:55.506166 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:55.506616 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:55.507374 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:55.507814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:55.511899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:55.634893 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:55.642212 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4e10382f-0f37-420d-9ac4-18ef5beb7687 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.147752 Jun 29 16:11:55.642765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 205/429] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:55 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:56.477466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:56.478009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:56.484069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:56.484507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:56.485244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:56.485668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:56.612397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:56.620555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6bfe14b9-0af9-4c9d-b04c-f0dc5f3ca8a3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.147499 Jun 29 16:11:56.621113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 225/430] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:56 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:56.659178 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:56.659871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:56.666859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:56.667302 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:56.668081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:56.668510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:57.017371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:57.028074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-16ee3299-c6f4-4cba-9d4b-a5f040b1e471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.372626 Jun 29 16:11:57.028732 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 206/431] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:56 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:57.637355 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:57.637953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:57.639846 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=97 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:57.645261 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:57.645705 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:57.646454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:57.646880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:57.771676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:57.779510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-562f2bb5-de7e-4f78-8db6-102d76698915 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.145933 Jun 29 16:11:57.780278 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 226/432] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:57 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:58.044438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:58.045042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:58.051605 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:58.052090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:58.052852 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:58.053286 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:58.182068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:58.191171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd403d40-f7e6-4137-ab65-c1ea6cd98a25 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.150263 Jun 29 16:11:58.191921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 207/433] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:58 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:58.796406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:58.797011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:58.803613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:58.804080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:58.804821 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:58.805250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:58.944311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:58.951997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-84d935f6-b75e-476c-9793-fd6ac17be8b9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.159251 Jun 29 16:11:58.952488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 227/434] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:58 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:59.208967 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:59.209574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:59.215651 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:59.216142 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:59.216897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:59.217325 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:59.369787 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:11:59.378969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-39e5ea8c-790a-4b39-9a7a-0c0e9b35aecf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1364 microversion: 2.1 time: 0.174134 Jun 29 16:11:59.380152 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 208/435] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:59 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:11:59.977676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:11:59.978471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:11:59.984696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:59.985223 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:11:59.986050 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:11:59.986478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:00.132437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:00.141028 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b3be81ea-e830-4a10-9083-f955d4ce7042 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.167171 Jun 29 16:12:00.150824 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 228/436] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:11:59 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:00.396943 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:00.397547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:00.399878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=69 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:00.405074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:00.405518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:00.406283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:00.406713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:00.545050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:00.553073 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4dd97f9c-15bd-4741-9773-153d4ff0aad6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1550 microversion: 2.1 time: 0.160333 Jun 29 16:12:00.553935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 209/437] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:00 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:00.570409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:00.570897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:00.578244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:00.578695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:00.579448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:00.579899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:00.664001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-07295332-701a-4041-b0fa-b25b8b5c9985 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097363 Jun 29 16:12:00.664592 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 229/438] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:12:00 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:12:01.158744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:01.159346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:01.165463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:01.165904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:01.166664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:01.167091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:01.410274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:01.420670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a48ca171-9dff-40b3-a998-f2fb54d8ab0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.265937 Jun 29 16:12:01.431974 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 210/439] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:01 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:02.017109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-902908c3-1148-4cd6-9881-5d9d46c6d7e1 req-1eea5072-e819-4561-beb1-e271b3f4c3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c82fec7-271e-4a90-82ae-0425c0c53431", "tag": "7303208a-252a-4cdb-a5b7-e4a759514ef5"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:02.028308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-902908c3-1148-4cd6-9881-5d9d46c6d7e1 req-1eea5072-e819-4561-beb1-e271b3f4c3df service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.028778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-902908c3-1148-4cd6-9881-5d9d46c6d7e1 req-1eea5072-e819-4561-beb1-e271b3f4c3df service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.040835 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-902908c3-1148-4cd6-9881-5d9d46c6d7e1 req-1eea5072-e819-4561-beb1-e271b3f4c3df service nova] Creating event network-changed:7303208a-252a-4cdb-a5b7-e4a759514ef5 for instance 6c82fec7-271e-4a90-82ae-0425c0c53431 on hv-cinder-84814 Jun 29 16:12:02.046764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-902908c3-1148-4cd6-9881-5d9d46c6d7e1 req-1eea5072-e819-4561-beb1-e271b3f4c3df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033156 Jun 29 16:12:02.047346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 230/440] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:12:02.371024 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:02.371517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:02.377766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.378206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.378956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.379381 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.404991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:12:02.440236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:02.440927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:02.448887 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.449292 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.450236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.450671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.501707 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f3368c59-d9ce-4dbb-a9ce-08fb05d77679 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 204 len: 0 microversion: 2.1 time: 0.134166 Jun 29 16:12:02.502676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 211/441] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:12:02 2022] DELETE /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:12:02.516668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:02.517391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:02.523952 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.524610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.525363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:02.525950 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:02.593800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:02.601639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3b0e5a05-8fb0-4fc9-ad5d-2f27113fbcd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.165685 Jun 29 16:12:02.602611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 231/442] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:02 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:12:02.677257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:02.685188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-265d2f4d-e24e-4051-856a-b2758ee129ba tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1553 microversion: 2.1 time: 0.177760 Jun 29 16:12:02.685748 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 212/443] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:02 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:03.617892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:03.618502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:03.625329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:03.625777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:03.626870 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:03.627309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:03.703062 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:03.703586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:03.710844 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:03.711504 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:03.712371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:03.712855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:03.767128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:03.776390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-085cf49e-93de-43f6-98da-2256ee09539b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.162195 Jun 29 16:12:03.777507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 232/444] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:03 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:03.852608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:03.861141 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0871a49a-0d7c-4c08-bde9-a8feb673c74e tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1553 microversion: 2.1 time: 0.162126 Jun 29 16:12:03.861711 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 213/445] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:03 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:04.794786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:04.795362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:04.802059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:04.802500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:04.803243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:04.803670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:04.878987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:04.879586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:04.886219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:04.886659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:04.887586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:04.888047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:04.932002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:04.939702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e2ef1ea9-1ee0-4852-ade3-85e68d377d60 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.148789 Jun 29 16:12:04.940382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 233/446] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:04 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:05.025766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:05.033785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-27df7a1f-36d9-4983-8314-b9e7c20b2041 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1553 microversion: 2.1 time: 0.158815 Jun 29 16:12:05.034349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 214/447] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:04 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:12:05.956706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:05.957235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:05.963418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:05.963883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:05.964626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:05.965051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:06.052269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:06.053516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:06.061834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:06.062551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:06.063545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:06.064663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:06.137045 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:06.145935 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dbdf4f2b-80df-44dc-9c98-b9e55e265f26 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.193074 Jun 29 16:12:06.146513 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 234/448] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:05 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:06.320991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:06.328918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5b03c71e-dec7-4d20-ab4d-6a6122df6124 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1553 microversion: 2.1 time: 0.281339 Jun 29 16:12:06.329686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 215/449] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:06 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:12:07.163925 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:07.163925 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:07.169864 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:07.170317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:07.171073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:07.171501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:07.302191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:07.309612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-de30c1b2-15a8-4824-a8f1-1269206346c0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.150774 Jun 29 16:12:07.310168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 235/450] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:07 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:07.346273 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:07.346817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:07.354047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:07.354488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:07.355231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:07.356019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:07.493872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:07.502244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9b8d8a4f-f0ef-4e92-9837-558b7abe06d5 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1553 microversion: 2.1 time: 0.159822 Jun 29 16:12:07.502839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 216/451] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:07 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:08.326235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:08.326766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:08.332835 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:08.333282 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:08.334035 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:08.334466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:08.466460 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:08.474920 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c408bad4-18a6-41a9-aef1-52c3b262eb22 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1521 microversion: 2.1 time: 0.152635 Jun 29 16:12:08.475490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 236/452] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:08 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:08.520148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:08.520741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:08.526934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:08.527446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:08.528289 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:08.528779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:09.050954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:09.058877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-caa3c54d-30f2-4c05-adac-b2733df447ea tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1553 microversion: 2.1 time: 0.542508 Jun 29 16:12:09.059435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 217/453] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:08 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1553 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:09.449207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-fe8d9a6b-cbc1-49e7-ba3a-64e28d718caa req-452fdd1c-6727-488f-8e94-b598c9659c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd", "name": "network-vif-deleted", "tag": "8c5430ef-08ce-4e09-b34f-53198b507833"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:09.459446 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-fe8d9a6b-cbc1-49e7-ba3a-64e28d718caa req-452fdd1c-6727-488f-8e94-b598c9659c19 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:09.460097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-fe8d9a6b-cbc1-49e7-ba3a-64e28d718caa req-452fdd1c-6727-488f-8e94-b598c9659c19 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:09.476540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-fe8d9a6b-cbc1-49e7-ba3a-64e28d718caa req-452fdd1c-6727-488f-8e94-b598c9659c19 service nova] Creating event network-vif-deleted:8c5430ef-08ce-4e09-b34f-53198b507833 for instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd on hv-cinder-84814 Jun 29 16:12:09.481870 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-fe8d9a6b-cbc1-49e7-ba3a-64e28d718caa req-452fdd1c-6727-488f-8e94-b598c9659c19 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037070 Jun 29 16:12:09.482552 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 237/454] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:12:09.493421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:09.494330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:09.509185 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:09.515263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:09.516586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:09.517209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:09.673553 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:09.681460 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5cb284e2-1c6a-42ae-b234-dca91348a608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1501 microversion: 2.1 time: 0.193852 Jun 29 16:12:09.682021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 218/455] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:09 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:09.698075 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:09.698797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:09.704972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:09.705418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:09.706169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:09.706600 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:09.710578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:09.843002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:09.852010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-53b36005-0d67-4040-b71b-51cebc9a6480 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1516 microversion: 2.1 time: 0.158015 Jun 29 16:12:09.852578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 238/456] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:09 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:10.083394 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:10.084650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:10.102815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:10.103021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:10.103785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:10.104242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:10.139753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:10.140550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:10.141085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lazy-loading 'fault' on Instance uuid 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:12:10.198829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:10.202764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:10.209143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-551be743-8406-4189-8ad1-7bd889adc2c6 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1350 microversion: 2.1 time: 0.136374 Jun 29 16:12:10.209702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 219/457] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:10 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:11.226688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:11.227288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:11.233659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:11.234101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:11.234847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:11.235275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:11.266987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:11.267421 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:11.267907 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lazy-loading 'fault' on Instance uuid 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:12:11.310025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba6701e26058440fa098a6a0e9da7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0add8dd81ce48dda51cbca71cd875d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:11.318427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b44824e2-70fe-48ae-87f5-b7edacf8b5b1 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 200 len: 1350 microversion: 2.1 time: 0.096180 Jun 29 16:12:11.319160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 239/458] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:11 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:12.335412 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:12.336165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:12.344134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:12.344578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:12.345483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:12.345748 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:12.360462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] HTTP exception thrown: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Request method failure captured: Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd HTTP/1.1 Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlTGOZkiRu0gH48o1VqJXdBWjZqMkcm30vhkQ5n7cpOZeGunDl1-lz-quK3bOqdcjckQ3Qn82m-qqDU2rWfZVSbBwEiawZFmY-YvxNYtVFpj05p52CGpQp82dp-3ttFhS80XI7T_VbG6IgqufdhtlX6M6Ki-QgVHG3y1uZpouC17rE Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:12:12.365617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a0add8dd81ce48dda51cbca71cd875d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: ba6701e26058440fa098a6a0e9da7f1a Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.367207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd'} Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:12:12.368109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.369571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.371122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Returning 404 to user: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:12:12.371122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b9fa6e35-6f16-473c-b57d-05df7f5bdcaf tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 404 len: 111 microversion: 2.1 time: 0.035548 Jun 29 16:12:12.371122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 220/459] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:12 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:12:12.471785 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:12.473172 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:12.486268 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:12.486268 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:12.486268 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:12.486268 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:12.494240 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] HTTP exception thrown: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Request method failure captured: Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd/os-volume_attachments HTTP/1.1 Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlTGOZkiRu0gH48o1VqJXdBWjZqMkcm30vhkQ5n7cpOZeGunDl1-lz-quK3bOqdcjckQ3Qn82m-qqDU2rWfZVSbBwEiawZFmY-YvxNYtVFpj05p52CGpQp82dp-3ttFhS80XI7T_VbG6IgqufdhtlX6M6Ki-QgVHG3y1uZpouC17rE Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:12:12.498530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a0add8dd81ce48dda51cbca71cd875d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: ba6701e26058440fa098a6a0e9da7f1a Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.500067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'server_id': '4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd'} Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:12:12.500894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:12.502215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:12.503585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Returning 404 to user: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:12:12.503585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7df7d746-d08b-48c4-bcc6-57dad527a7f8 tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032009 Jun 29 16:12:12.503585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 240/460] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:12:12 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:12:24.016582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:24.017608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:24.020226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:24.020874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:24.030121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:24.030121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:24.030121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:24.030121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:24.054200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lazy-loading 'flavor' on Instance uuid dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:12:24.166316 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ecb0cf3a-5df3-4b68-a53d-7c7fed121143 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/action" status: 200 len: 32 microversion: 2.1 time: 0.153611 Jun 29 16:12:24.172452 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 221/461] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:12:24 2022] POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:12:24.178554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:24.180464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:24.182216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=31 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:24.183521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=14 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:24.189827 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:24.190495 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:24.191366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:24.191789 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:24.331628 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:24.340794 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c542c372-2b98-4f13-8905-1bb8f7d7ad0b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.166723 Jun 29 16:12:24.341401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 241/462] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:24 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:12:25.359012 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:25.359649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:25.366505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:25.366986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:25.367743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:25.368206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:25.494685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:25.502392 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-70ce80fa-4e53-4387-abf8-52f1282d73e7 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.148062 Jun 29 16:12:25.502958 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 222/463] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:25 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:26.286002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:26.286499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:26.293068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:26.293516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:26.294272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:26.294704 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:26.308699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] HTTP exception thrown: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Request method failure captured: Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd HTTP/1.1 Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlTGOZkiRu0gH48o1VqJXdBWjZqMkcm30vhkQ5n7cpOZeGunDl1-lz-quK3bOqdcjckQ3Qn82m-qqDU2rWfZVSbBwEiawZFmY-YvxNYtVFpj05p52CGpQp82dp-3ttFhS80XI7T_VbG6IgqufdhtlX6M6Ki-QgVHG3y1uZpouC17rE Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:12:26.310843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a0add8dd81ce48dda51cbca71cd875d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: ba6701e26058440fa098a6a0e9da7f1a Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.312450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd'} Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:12:26.313208 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.314533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.316060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Returning 404 to user: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:12:26.316060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dddde9a7-088e-4216-9e98-f1e5a18aa0ff tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 404 len: 111 microversion: 2.1 time: 0.030107 Jun 29 16:12:26.316060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 242/464] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:12:26 2022] DELETE /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:12:26.320645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:26.321256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] [instance: 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:26.327117 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:26.327565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:26.328352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:26.328791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:26.343398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] HTTP exception thrown: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Request method failure captured: Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd HTTP/1.1 Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlTGOZkiRu0gH48o1VqJXdBWjZqMkcm30vhkQ5n7cpOZeGunDl1-lz-quK3bOqdcjckQ3Qn82m-qqDU2rWfZVSbBwEiawZFmY-YvxNYtVFpj05p52CGpQp82dp-3ttFhS80XI7T_VbG6IgqufdhtlX6M6Ki-QgVHG3y1uZpouC17rE Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:12:26.345045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0add8dd81ce48dda51cbca71cd875d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a0add8dd81ce48dda51cbca71cd875d5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: a0add8dd81ce48dda51cbca71cd875d5 Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-142372462 Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: ba6701e26058440fa098a6a0e9da7f1a Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-142372462-project Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.346414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd'} Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:12:26.347156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. Jun 29 16:12:26.348336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:26.349311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] Returning 404 to user: Instance 4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:12:26.349311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2420e347-4021-411d-bfe8-8309a69c86de tempest-DeleteServersTestJSON-142372462 tempest-DeleteServersTestJSON-142372462-project] 10.222.0.47 "GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd" status: 404 len: 111 microversion: 2.1 time: 0.029776 Jun 29 16:12:26.349311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 223/465] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:26 2022] GET /compute/v2.1/servers/4c2c1b61-3bb3-4ea8-ab66-b0f322e855dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:12:26.520006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:26.520621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:26.527216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:26.527901 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:26.528680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:26.529783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:26.782939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:26.790985 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-293b6d56-565e-4e29-8396-4ce3ea5121e9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.275032 Jun 29 16:12:26.791543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 243/466] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:26 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:12:27.808333 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:27.808931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:27.815245 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:27.815772 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:27.816560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:27.817005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:27.947686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:27.955038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3a0bcba9-cee5-412a-8f34-388f12294b06 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.151092 Jun 29 16:12:27.955594 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 224/467] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:27 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:28.976555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:28.977256 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:28.983260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:28.983712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:28.984533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:28.984968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:29.260883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:29.268467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-92257d26-0956-4e1b-bb3e-d6ed8bf57d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.295840 Jun 29 16:12:29.269094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 244/468] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:28 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:30.285218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:30.285946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:30.292494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:30.293011 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:30.293829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:30.294322 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:30.460882 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:30.469169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8752940-aefb-4888-969e-ea54d4d65596 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.187765 Jun 29 16:12:30.470179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 225/469] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:30 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:31.485668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:31.486278 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:31.492879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:31.493327 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:31.494088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:31.494520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:31.627924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:31.636051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b261d399-9449-4c9c-9871-a5e1935e3078 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.154102 Jun 29 16:12:31.645522 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 245/470] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:31 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:32.653415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:32.653801 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:32.660795 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:32.661305 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:32.662070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:32.662499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:32.846120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:32.854002 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-475d81e2-57da-42fb-be0d-5628a9600b2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.204615 Jun 29 16:12:32.854648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 226/471] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:32 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:33.870792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:33.871615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:33.878228 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:33.878754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:33.879586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:33.880136 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:34.016554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:34.025374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b2aa2615-0b03-4800-aa6b-410bdde2a32e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.158556 Jun 29 16:12:34.026534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 246/472] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:33 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:35.042877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:35.043489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:35.050151 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:35.050683 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:35.051449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:35.051910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:35.191098 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:35.199208 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-01a30d31-ff15-45ba-9168-5e8abb772378 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.160780 Jun 29 16:12:35.199862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 227/473] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:35 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:36.215395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:36.216126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:36.222205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:36.222641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:36.223382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:36.224002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:36.352335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:36.359911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3ec1971a-646e-404a-9f44-031ce50bc53e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.148253 Jun 29 16:12:36.360477 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 247/474] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:36 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:37.376990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:37.377599 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:37.384378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:37.384810 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:37.385583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:37.386009 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:37.530913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:37.538609 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e3bee736-1d22-4f5e-870e-efcc55f68e4d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.165753 Jun 29 16:12:37.542338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 228/475] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:37 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:38.557166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:38.557828 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:38.565979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:38.567780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:38.568900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:38.570398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:38.705756 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:38.715028 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bad70ffc-4efa-43b2-a19d-5a38d59ed672 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.162658 Jun 29 16:12:38.715591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 248/476] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:38 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:39.731543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:39.732202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:39.738730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:39.739176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:39.739962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:39.740394 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:39.865615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:39.873070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ef38b7bc-c573-4960-adfc-f51320ea93d0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.145295 Jun 29 16:12:39.873619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 229/477] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:39 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:40.890418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:40.890961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:40.897034 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:40.897478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:40.899077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:40.899514 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:41.031044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:41.038485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-33a73c7d-d897-48f9-8508-61c6b7ecbece tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.152248 Jun 29 16:12:41.039744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 249/478] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:40 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:42.055983 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:42.058796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:42.063069 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:42.063914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:42.064821 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:42.065253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:42.234920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:42.242900 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-68746418-81ee-48e3-8b0b-0e679b141105 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.190281 Jun 29 16:12:42.243456 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 230/479] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:42 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:43.260455 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:43.261269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:43.269172 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:43.269842 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:43.271596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:43.272156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:43.415512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:43.423885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0da802e7-9cf7-4314-b776-43888fda5158 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.167883 Jun 29 16:12:43.424680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 250/480] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:43 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:44.442205 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:44.442813 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:44.449803 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:44.450250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:44.450995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:44.451427 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:44.591030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:44.599364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2dcf66c2-a9ba-4a9e-8cce-083030ca2e66 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.160953 Jun 29 16:12:44.600101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 231/481] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:44 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:45.617020 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:45.617532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:45.626283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.626283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.626283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.626283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.771563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:45.781683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fdbb36c6-ccc2-4d52-8b67-cf4ab0251aae tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1502 microversion: 2.1 time: 0.168560 Jun 29 16:12:45.782259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 251/482] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:45 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:45.798267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb17617a-8e9d-424d-8fa3-ddb93c362dbf"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:45.799371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:45.806370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.806831 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.807602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.808065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.832997 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] HTTP exception thrown: Cannot 'attach_volume' instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 while it is in vm_state rescued Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Request method failure captured: Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/os-volume_attachments HTTP/1.1 Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 74 Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlXw1Xys1yLNlsVxFpzGFllqOJH4MLqZcWiNaXyWAAyEU8Dgm4FVBsRAlPVamkBLTLYGZSjigNnLlFpOZ-Qrb_KvL-sLmWKrZQLxM3Nqmbey4d0JTFfSmVGFeyQhlKDvOy4Dr54Pv8vxKPRw-pmt5UxyLLEmpM21MEZO_yM8QgB4QM Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:12:45.834576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a410f5a9cef44b39a657b28f6c1772b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 1c00db02926f4d849249c3990fdf8308 Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {"volumeAttachment": {"volumeId": "eb17617a-8e9d-424d-8fa3-ddb93c362dbf"}} Jun 29 16:12:45.836859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Cannot 'attach_volume' instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 while it is in vm_state rescued Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'server_id': 'dcf0d9bb-22cd-43e2-a70c-ea778282a1d7', 'body': {'volumeAttachment': {'volumeId': 'eb17617a-8e9d-424d-8fa3-ddb93c362dbf'}}} Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:12:45.837634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 while it is in vm_state rescued Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:12:45.838798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:12:45.839892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:12:45.839892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:12:45.839892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 while it is in vm_state rescued Jun 29 16:12:45.839892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:12:45.841514 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Returning 409 to user: Cannot 'attach_volume' instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 while it is in vm_state rescued {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:12:45.842375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-769a7ea7-95f7-41d0-a519-86965608f22d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048524 Jun 29 16:12:45.842930 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 232/483] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:12:45 2022] POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 16:12:45.853259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:45.853738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:45.859743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.860226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.860987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.861417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.944744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5941dc5a-8bfa-4ecf-8dd8-45bcba3ef28f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/action" status: 202 len: 0 microversion: 2.1 time: 0.094542 Jun 29 16:12:45.946581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 252/484] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:12:45 2022] POST /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 16:12:45.957583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:45.958518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:45.969097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.969830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:45.970910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:45.971358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:46.254633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:46.263283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5f1f5f07-5347-4864-ac8a-fd45b455b9a8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1510 microversion: 2.1 time: 0.311925 Jun 29 16:12:46.263877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 233/485] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:45 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:47.281246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:47.282127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:47.294012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:47.294759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:47.295722 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:47.296299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:47.441544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:47.449787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c67c3c2a-e3f1-4c29-a7b1-7211a75e7178 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1510 microversion: 2.1 time: 0.172665 Jun 29 16:12:47.450738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 253/486] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:47 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:48.468362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:48.468978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:48.475527 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:48.476181 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:48.477767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:48.478345 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:48.624550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:48.633865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c8099294-112a-496b-b99c-06586a63e1ed tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1510 microversion: 2.1 time: 0.169756 Jun 29 16:12:48.642883 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 234/487] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:48 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:49.650700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:49.651867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:49.663442 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:49.663942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:49.664705 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:49.665140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:49.878099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:49.891526 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f6d0e82e-f40a-4969-98a4-83b23550b05b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1510 microversion: 2.1 time: 0.245008 Jun 29 16:12:49.892948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 254/488] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:49 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:50.908657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:50.909264 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:50.916326 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:50.917731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:50.918663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:50.919564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:51.113041 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:51.122646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-148632bd-8820-421b-b9a5-34e8cbefe459 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1516 microversion: 2.1 time: 0.217604 Jun 29 16:12:51.123237 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 235/489] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:50 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:52.720647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-314cef9d-6d2e-447f-b4d2-a641bc2eb6b1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'create', calling method: .version_select at 0x7f04375f2790>, body: {"keypair": {"name": "tempest-keypair-1335581155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/JHINyCDzKzh7+rE2Z07NoCfXfJUp+rHa5MDzj+zIIXWTiXGAf59jGhsrVuoCPBqVFee1n5BvJNlx/tQsxlMZAgDirDDBYVHC4QqmNY0HUr0bObYzvSMGNFErY79GPYQ=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:52.740745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-314cef9d-6d2e-447f-b4d2-a641bc2eb6b1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:12:52.746077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-314cef9d-6d2e-447f-b4d2-a641bc2eb6b1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for user 1c00db02926f4d849249c3990fdf8308 and project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:12:52.781999 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-314cef9d-6d2e-447f-b4d2-a641bc2eb6b1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065133 Jun 29 16:12:52.788330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 255/490] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:12:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:12:54.939332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2132238170", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02207256-1ae5-4ba0-a64e-1eb06f43dbfd"}], "security_groups": [{"name": "tempest-securitygroup--970385110"}], "key_name": "tempest-keypair-1335581155", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:12:54.949616 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=31 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:55.090778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] validate_networks() for [('02207256-1ae5-4ba0-a64e-1eb06f43dbfd', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:12:55.708291 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:12:55.708904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:12:55.710232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:12:55.710646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:12:55.713971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:12:55.738562 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:55.739363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:55.750834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:55.751307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:55.762896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:55.812954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:12:55.827872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Getting quotas for user 1c00db02926f4d849249c3990fdf8308 and project 6a410f5a9cef44b39a657b28f6c1772b. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:12:55.843060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:12:55.846118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:12:55.916977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-246eda6e-9d35-4ad7-9511-0b1256d461d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.983668 Jun 29 16:12:55.927885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a160f535-834b-4958-8b80-809c32a94cad tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:55.928489 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a160f535-834b-4958-8b80-809c32a94cad tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:55.931700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:55.934807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 236/491] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:12:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:12:56.038368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a160f535-834b-4958-8b80-809c32a94cad tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:56.060994 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a160f535-834b-4958-8b80-809c32a94cad tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1246 microversion: 2.1 time: 0.125929 Jun 29 16:12:56.063064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 256/492] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:55 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1246 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:57.081958 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:57.082658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:57.118303 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:57.118761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:57.123945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:57.124687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:57.253641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:57.265045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fd6ea6a7-c03f-4ae5-8f11-6c59d145c63b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1298 microversion: 2.1 time: 0.187962 Jun 29 16:12:57.276065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 237/493] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:57 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:58.286786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:58.287555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:58.304269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:58.306434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:58.308406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:58.311431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:58.331049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:58.535508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:12:58.545262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ff546b3c-b6fa-4c74-9518-3f63f8571d7d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1304 microversion: 2.1 time: 0.264105 Jun 29 16:12:58.547002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 257/494] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:58 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1304 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:12:59.573275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:12:59.578724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:12:59.593623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:59.595459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:12:59.597233 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:12:59.598650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:00.147175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-5c9c6d24-f593-414d-8230-bc426aa7f513 req-6189b613-e492-4159-a821-6ba6ba13626a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042", "tag": "d0ad8518-66f0-4e4c-94ca-b7954be0243d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:00.155712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:00.162774 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-5c9c6d24-f593-414d-8230-bc426aa7f513 req-6189b613-e492-4159-a821-6ba6ba13626a service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:00.163288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-5c9c6d24-f593-414d-8230-bc426aa7f513 req-6189b613-e492-4159-a821-6ba6ba13626a service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:00.171020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a84857eb-f0b6-40a3-af18-8583c415ac25 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.610254 Jun 29 16:13:00.174671 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 238/495] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:12:59 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:00.187618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-5c9c6d24-f593-414d-8230-bc426aa7f513 req-6189b613-e492-4159-a821-6ba6ba13626a service nova] Creating event network-changed:d0ad8518-66f0-4e4c-94ca-b7954be0243d for instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 on hv-cinder-84814 Jun 29 16:13:00.202541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-5c9c6d24-f593-414d-8230-bc426aa7f513 req-6189b613-e492-4159-a821-6ba6ba13626a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059076 Jun 29 16:13:00.206591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 258/496] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:13:01.189432 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:01.190871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:01.200853 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:01.201645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:01.202452 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:01.203023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:01.404983 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:01.415091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fcf859f1-c970-4c20-bfe5-02c475315e8a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.231514 Jun 29 16:13:01.415681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 239/497] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:01 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:02.433078 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:02.434639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:02.442734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:02.443184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:02.444449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:02.445043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:02.617230 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:02.625975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0271fda6-4ba6-4382-8527-4f284c11f544 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.197898 Jun 29 16:13:02.627210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 259/498] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:02 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:03.642564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:03.643178 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:03.650785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:03.651566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:03.652747 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:03.653409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:03.801555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:03.810036 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9968ca96-c68c-4512-be3d-339a8c234030 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.171276 Jun 29 16:13:03.810599 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 240/499] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:03 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:04.828923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:04.829425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:04.842011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:04.842457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:04.843219 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:04.843731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:05.042921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:05.051553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f427b873-3985-4cc8-9909-f03030f77e35 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.228175 Jun 29 16:13:05.061573 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 260/500] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:04 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:06.072370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:06.077952 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:06.084904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:06.087012 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:06.090147 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:06.090825 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:06.092417 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:06.093123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:06.345822 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:06.356945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d06ca2b3-8100-4207-8f74-91fdbb6f8e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.290275 Jun 29 16:13:06.357555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 241/501] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:06 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:07.377041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:07.377634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:07.383223 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:07.385189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:07.385977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:07.387473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:07.388365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:07.591126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:07.605478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f564a087-3f5e-46aa-b397-88d239cf1411 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.234703 Jun 29 16:13:07.610196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 261/502] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:07 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:08.626644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:08.627291 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:08.634579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:08.636073 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:08.636902 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:08.637567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:08.783946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:08.793421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e17f4ec8-8db0-4e63-9639-2c79b6b2137a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.170764 Jun 29 16:13:08.804118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 242/503] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:08 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:09.810583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:09.811181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:09.822940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:09.823385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:09.824180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:09.824607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:09.892956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-bd9abf8e-7483-4e83-a6c6-2e6a2802bb36 req-34f7b52c-29ea-4a23-b00a-515cfaa30b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042", "name": "network-vif-plugged", "status": "completed", "tag": "d0ad8518-66f0-4e4c-94ca-b7954be0243d"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:09.921589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-bd9abf8e-7483-4e83-a6c6-2e6a2802bb36 req-34f7b52c-29ea-4a23-b00a-515cfaa30b07 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:09.922030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-bd9abf8e-7483-4e83-a6c6-2e6a2802bb36 req-34f7b52c-29ea-4a23-b00a-515cfaa30b07 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:09.950428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-bd9abf8e-7483-4e83-a6c6-2e6a2802bb36 req-34f7b52c-29ea-4a23-b00a-515cfaa30b07 service nova] Creating event network-vif-plugged:d0ad8518-66f0-4e4c-94ca-b7954be0243d for instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 on hv-cinder-84814 Jun 29 16:13:09.956692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-bd9abf8e-7483-4e83-a6c6-2e6a2802bb36 req-34f7b52c-29ea-4a23-b00a-515cfaa30b07 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067148 Jun 29 16:13:09.957908 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 243/504] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:10.085300 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:10.093895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8367c42c-3ae2-46dd-809d-0158ff37565c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.286979 Jun 29 16:13:10.094475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 262/505] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:09 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:11.111181 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:11.111895 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:11.119369 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:11.120299 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:11.121407 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:11.122136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:11.294976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:11.303895 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93b1ce68-e2ed-4327-b08c-1a027a2de230 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.197120 Jun 29 16:13:11.317633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 244/506] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:11 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:12.322682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:12.323433 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:12.332895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:12.333456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:12.334362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:12.335194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:12.519542 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:12.527087 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-00192ce4-e779-4362-bc6b-67905f2b01e2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1371 microversion: 2.1 time: 0.208439 Jun 29 16:13:12.527670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 263/507] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:12 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:13.546506 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:13.547870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:13.554324 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:13.555377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:13.556255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:13.556688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:13.650392 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9362bae1-1fe4-41e8-8bc3-e05630e88deb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Action: 'create', calling method: .version_select at 0x7f0434f28310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-308779180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6D+g9N6KdliAxW798zlXDilGZ3N8dIGWLBFG2JElEGIrofA872Fh5mYdILuOr4Tz5nj4gQKcs17f+ALPPfAtiBp4MTnOlbcMtkIeyjLa9mVugB8ja13IwVU6Mgmriwkw=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:13.664759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-9362bae1-1fe4-41e8-8bc3-e05630e88deb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Getting quotas for project cbd79cd5dd034dec885a0a56cd16b993. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:13:13.668688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-9362bae1-1fe4-41e8-8bc3-e05630e88deb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Getting quotas for user c7d0b7e3000444c1969640bfd27d72ba and project cbd79cd5dd034dec885a0a56cd16b993. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:13:13.692449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9362bae1-1fe4-41e8-8bc3-e05630e88deb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045860 Jun 29 16:13:13.693053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 264/508] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:13:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:13:13.694064 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:13.701520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3979cfce-56f0-48a4-82d0-f1de07e11cd8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1564 microversion: 2.1 time: 0.160770 Jun 29 16:13:13.702133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 245/509] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:13 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:13.717278 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:13.717770 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:13.723790 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:13.724267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:13.725071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:13.725448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:13.795081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1007188405", "imageRef": "3d306469-a225-4b61-b83c-382b42655c96", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-308779180", "networks": [{"uuid": "47d6c937-93d7-42a3-ac01-ed638afc885b"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:13.802080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-60b78516-a62a-43e7-92db-6d1eebddcf84 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088682 Jun 29 16:13:13.802748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 265/510] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:13:13 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:13.844821 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] validate_networks() for [('47d6c937-93d7-42a3-ac01-ed638afc885b', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:13:14.214120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:13:14.214544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:13:14.215015 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:13:14.215423 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:13:14.215849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:13:14.225592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:14.226136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:14.227072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:14.227502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:14.243886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Getting quotas for project cbd79cd5dd034dec885a0a56cd16b993. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:13:14.248086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Getting quotas for user c7d0b7e3000444c1969640bfd27d72ba and project cbd79cd5dd034dec885a0a56cd16b993. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:13:14.264260 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:13:14.266587 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3d306469-a225-4b61-b83c-382b42655c96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:13:14.312211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9abe6b75-700c-49f7-b6b0-2429d9a1aabf tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520862 Jun 29 16:13:14.313151 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 246/511] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 16:13:14.323270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cbaa87f3-142b-4c3a-9138-41fa3373868c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:14.323899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cbaa87f3-142b-4c3a-9138-41fa3373868c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:14.389327 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cbaa87f3-142b-4c3a-9138-41fa3373868c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:14.396437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cbaa87f3-142b-4c3a-9138-41fa3373868c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1258 microversion: 2.1 time: 0.077435 Jun 29 16:13:14.397003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 266/512] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:14 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:14.610713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1267199756", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:14.669446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] validate_networks() for None {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:13:14.740119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-e209a258-79dd-404a-8092-54df2d99a897 req-975829a6-3b1b-4627-8720-c70820692afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042", "tag": "d0ad8518-66f0-4e4c-94ca-b7954be0243d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:14.749638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-e209a258-79dd-404a-8092-54df2d99a897 req-975829a6-3b1b-4627-8720-c70820692afc service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:14.750553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-e209a258-79dd-404a-8092-54df2d99a897 req-975829a6-3b1b-4627-8720-c70820692afc service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:14.763457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-e209a258-79dd-404a-8092-54df2d99a897 req-975829a6-3b1b-4627-8720-c70820692afc service nova] Creating event network-changed:d0ad8518-66f0-4e4c-94ca-b7954be0243d for instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 on hv-cinder-84814 Jun 29 16:13:14.769730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-e209a258-79dd-404a-8092-54df2d99a897 req-975829a6-3b1b-4627-8720-c70820692afc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Jun 29 16:13:14.770351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 267/513] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:13:15.278439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:13:15.278865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:13:15.279281 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:13:15.279676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:13:15.280293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:13:15.291250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:15.291722 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:15.292562 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:15.292991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:15.312483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Getting quotas for project 5175c3cc5ca74d07883332f918ca6403. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:13:15.316353 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Getting quotas for user 10438d22afcd45e8a6cb8fb5b119c4db and project 5175c3cc5ca74d07883332f918ca6403. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:13:15.327927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:13:15.330039 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:13:15.391048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-38831b99-b1e7-4fe3-8d92-e71aa5abc0de tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784016 Jun 29 16:13:15.391689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 247/514] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:13:15.404189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7904b69f-21f6-4029-867b-a925ccfaf945 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:15.405085 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7904b69f-21f6-4029-867b-a925ccfaf945 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:15.418937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c456f312-7f1e-4388-9330-d93f83c8585c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:15.420201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c456f312-7f1e-4388-9330-d93f83c8585c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:15.489502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7904b69f-21f6-4029-867b-a925ccfaf945 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:15.500826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7904b69f-21f6-4029-867b-a925ccfaf945 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1215 microversion: 2.1 time: 0.101663 Jun 29 16:13:15.501617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 268/515] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:15 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:15.520712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c456f312-7f1e-4388-9330-d93f83c8585c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:15.530482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c456f312-7f1e-4388-9330-d93f83c8585c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1258 microversion: 2.1 time: 0.119243 Jun 29 16:13:15.531345 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 248/516] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:15 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1258 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:16.517817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:16.519017 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:16.527506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:16.528469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:16.529344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:16.529995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:16.550924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb53030e-72f2-472f-a048-081811cb396a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:16.551932 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eb53030e-72f2-472f-a048-081811cb396a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:16.602846 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:16.610517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-00352c5f-f5c5-421b-a75c-9b4a30d343a5 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1275 microversion: 2.1 time: 0.096885 Jun 29 16:13:16.611177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 269/517] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:16 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:16.666941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eb53030e-72f2-472f-a048-081811cb396a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:16.674623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eb53030e-72f2-472f-a048-081811cb396a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1258 microversion: 2.1 time: 0.129432 Jun 29 16:13:16.675355 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 249/518] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:16 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1258 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:17.629127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:17.631580 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:17.638299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:17.638755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:17.639525 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:17.639992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:17.692600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c58f4399-a4c9-426b-9512-4c8c02e11cbc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:17.694985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c58f4399-a4c9-426b-9512-4c8c02e11cbc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:17.787923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c58f4399-a4c9-426b-9512-4c8c02e11cbc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:17.797287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c58f4399-a4c9-426b-9512-4c8c02e11cbc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1258 microversion: 2.1 time: 0.109196 Jun 29 16:13:17.797942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:17.806189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 250/519] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:17 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1258 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:17.810190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e87f7394-f778-4a24-b19f-d84d2598b8c8 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.186365 Jun 29 16:13:17.812220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 270/520] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:17 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:18.002039 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ba78110d-53b9-4a39-a40e-48eb7ab9eb0c req-aa624d10-6db6-4ff3-a8a9-46940eb34b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba61073-5fc9-411d-8ee6-66146a5d4500", "tag": "4d3af398-2c01-4b9f-acc8-c2cd7fd37ddd"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:18.016434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ba78110d-53b9-4a39-a40e-48eb7ab9eb0c req-aa624d10-6db6-4ff3-a8a9-46940eb34b64 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:18.017191 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ba78110d-53b9-4a39-a40e-48eb7ab9eb0c req-aa624d10-6db6-4ff3-a8a9-46940eb34b64 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:18.028919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ba78110d-53b9-4a39-a40e-48eb7ab9eb0c req-aa624d10-6db6-4ff3-a8a9-46940eb34b64 service nova] Creating event network-changed:4d3af398-2c01-4b9f-acc8-c2cd7fd37ddd for instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 on hv-cinder-84814 Jun 29 16:13:18.033965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ba78110d-53b9-4a39-a40e-48eb7ab9eb0c req-aa624d10-6db6-4ff3-a8a9-46940eb34b64 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036277 Jun 29 16:13:18.034873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 251/521] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:18.815751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:18.816394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:18.822948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:18.823391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:18.824169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:18.824597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:18.829713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:18.830424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:18.837177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:18.837623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:18.838375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:18.838812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:18.885478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:18.892727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c95a5e74-a50e-4bc8-910e-51bc42e145b4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1262 microversion: 2.1 time: 0.080824 Jun 29 16:13:18.893289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 271/522] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:18 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:18.972816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:18.982951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a7dd30df-f4a0-4bc1-b7ad-18750ae744af tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.157933 Jun 29 16:13:18.983515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 252/523] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:18 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:19.909397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:19.910028 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:19.916077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:19.916526 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:19.917289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:19.917720 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:19.976936 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:19.984415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-af7cb3b5-752d-4b99-ac99-baf6b3491986 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1262 microversion: 2.1 time: 0.078925 Jun 29 16:13:19.984969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 272/524] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:19 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:19.999593 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:20.000488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:20.006900 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:20.007347 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:20.008681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:20.009115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:20.139058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:20.146307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-452646cb-523e-4446-b0a1-f2341b0e48c9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.150569 Jun 29 16:13:20.146857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 253/525] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:19 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:21.002109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:21.002720 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:21.008805 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:21.009252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:21.010006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:21.010439 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:21.071461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:21.079014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-26d9ed20-f8a1-4e3c-a869-f940196490dd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1262 microversion: 2.1 time: 0.081051 Jun 29 16:13:21.079574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 273/526] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:20 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:21.163067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:21.163640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:21.170072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:21.170516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:21.171275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:21.171701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:21.298549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:21.306525 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b318709e-cc18-4b32-9294-fd9a234f3def tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.147385 Jun 29 16:13:21.307097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 254/527] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:21 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:22.094759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:22.095366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:22.101870 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:22.102317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:22.103065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:22.103494 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:22.163408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:22.172328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bf4a93e1-29d7-46d4-a128-874a17f6a4dc tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1310 microversion: 2.1 time: 0.081390 Jun 29 16:13:22.173930 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 274/528] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:22 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:22.323939 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:22.324892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:22.331449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:22.332141 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:22.332961 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:22.333462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:22.517632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:22.542630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dd5b5de3-24d8-40b8-a561-144b5d7c1038 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.222168 Jun 29 16:13:22.543714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 255/529] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:22 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:23.190335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:23.192355 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:23.200937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:23.201385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:23.202156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:23.202596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:23.340159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:23.352025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-047e16d7-4bb6-410d-a60b-5c8c56f7da4b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.164569 Jun 29 16:13:23.353183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 275/530] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:23 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:23.374487 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:13:23.375050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:13:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:13:23.525964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:13:23.526179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Wed Jun 29 16:13:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:13:23.559107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:23.559724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:23.578613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:23.579063 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:23.579896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:23.580289 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:23.732717 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:23.740196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3a21096b-7e76-4f11-a9bc-9c21068e0b0a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.184899 Jun 29 16:13:23.740758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 256/531] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:23 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:23.987773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-32775cb4-5e2d-40c6-b30a-fc901ee5bd5d req-1f266122-efad-4a51-b2b5-4f7712fc649e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba61073-5fc9-411d-8ee6-66146a5d4500", "name": "network-vif-plugged", "status": "completed", "tag": "4d3af398-2c01-4b9f-acc8-c2cd7fd37ddd"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:23.996881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-32775cb4-5e2d-40c6-b30a-fc901ee5bd5d req-1f266122-efad-4a51-b2b5-4f7712fc649e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:23.997356 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-32775cb4-5e2d-40c6-b30a-fc901ee5bd5d req-1f266122-efad-4a51-b2b5-4f7712fc649e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:24.009792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-32775cb4-5e2d-40c6-b30a-fc901ee5bd5d req-1f266122-efad-4a51-b2b5-4f7712fc649e service nova] Creating event network-vif-plugged:4d3af398-2c01-4b9f-acc8-c2cd7fd37ddd for instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 on hv-cinder-84814 Jun 29 16:13:24.014683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-32775cb4-5e2d-40c6-b30a-fc901ee5bd5d req-1f266122-efad-4a51-b2b5-4f7712fc649e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031838 Jun 29 16:13:24.015298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 276/532] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:24.372847 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:24.373601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:24.383456 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:24.384155 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:24.384805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:24.385418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:24.518430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:24.525874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f2360c8d-489b-4552-8f7a-a4d38734a4f8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.159495 Jun 29 16:13:24.526421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 257/533] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:24 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:24.757814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:24.758509 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:24.764844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:24.765290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:24.766041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:24.766471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:24.897396 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:24.906410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-48ebef68-40d8-48f3-b8f3-0cd35a0ed613 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.152738 Jun 29 16:13:24.907203 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 277/534] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:24 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:25.543014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:25.543733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:25.546014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:25.546703 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:25.552934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:25.553377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:25.554142 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:25.554598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:25.686384 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:25.693730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-543ed936-a47d-48b4-a635-99c183ec6292 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.155169 Jun 29 16:13:25.694285 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 258/535] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:25 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:25.924288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:25.924946 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:25.926905 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=8 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:25.933285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:25.933727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:25.934486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:25.934916 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:26.071370 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:26.079892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b38424a3-6743-4c3a-80b1-616fdb50438e tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.159233 Jun 29 16:13:26.080615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 278/536] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:25 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:26.709446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:26.710046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:26.716602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:26.717040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:26.717779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:26.718204 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:26.722201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:26.873108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:26.881273 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-634c8f77-acf4-4903-9066-4689fcf0f67d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.175483 Jun 29 16:13:26.885770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 259/537] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:26 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:27.099565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:27.100532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:27.104723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:27.109341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:27.109868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:27.110764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:27.111217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:27.116855 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:27.256961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:27.264469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-39e06632-6f16-45b2-abe1-417054b24cb9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.169526 Jun 29 16:13:27.265022 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 279/538] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:27 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:27.898053 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:27.898647 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:27.900960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=18 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:27.906372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:27.906812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:27.907554 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:27.908012 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:28.051130 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:28.061473 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d5cf0e5-4eb9-4784-b161-d3eb0e97ab3d tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.166681 Jun 29 16:13:28.066475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 260/539] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:27 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:28.281732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:28.282349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:28.288302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:28.288747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:28.290044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:28.290475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:28.443561 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:28.450962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b8511830-7672-4b91-a662-0bbf73fb4eea tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.173169 Jun 29 16:13:28.451530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 280/540] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:28 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:29.079927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:29.080543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:29.088014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:29.088461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:29.089220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:29.089657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:29.214026 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:29.221295 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d02f953-d535-4bd6-b82c-d6d422a52a24 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.145264 Jun 29 16:13:29.221857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 261/541] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:29 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:29.466824 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:29.467350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:29.473547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:29.473989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:29.474741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:29.475164 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:29.620697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:29.629057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-955de3c4-d981-4270-b45a-f13a5de95587 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.165777 Jun 29 16:13:29.630105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 281/542] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:29 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:30.238113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:30.238909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:30.245364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:30.245737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:30.246488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:30.246916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:30.384275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:30.391532 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-798b13c5-3418-4d97-ae91-3e3de0b30166 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.157320 Jun 29 16:13:30.392135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 262/543] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:30 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:30.649296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:30.649852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:30.655807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:30.656294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:30.657031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:30.657451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:30.809829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:30.817348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-59661e0c-f61a-45e2-9743-500ba31fb091 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.172607 Jun 29 16:13:30.827145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 282/544] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:30 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:31.409141 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:31.409727 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:31.416600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:31.417034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:31.417775 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:31.418204 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:31.551124 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:31.559690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71007096-50d6-4ca5-920c-f593e88636d3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.154290 Jun 29 16:13:31.560556 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 263/545] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:31 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:31.838826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:31.844898 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:31.861892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:31.862337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:31.863108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:31.863541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:32.000958 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:32.008943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-79c64ad7-5173-456a-8665-296384b1b1eb tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.174202 Jun 29 16:13:32.009360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 283/546] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:31 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:32.578692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:32.579988 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:32.589557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:32.590248 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:32.591197 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:32.591780 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:32.734805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:32.742335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8fdcbf7-19b5-4b30-b2a0-510ae5e0cfbb tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.168448 Jun 29 16:13:32.742903 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 264/547] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:32 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:33.028028 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:33.028800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:33.036730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:33.037177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:33.037942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:33.038370 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:33.168210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:33.175412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-951450e7-e667-4752-946e-c1bfc133744a tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.152992 Jun 29 16:13:33.176019 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 284/548] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:33 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:33.758612 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:33.759215 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:33.765642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:33.766082 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:33.766820 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:33.767246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:33.903001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:33.910729 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4d6327a6-643c-41f8-9867-bfcb3be68c9b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.155801 Jun 29 16:13:33.911512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 265/549] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:33 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:34.193046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:34.194179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:34.201802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:34.202305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:34.203565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:34.204234 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:34.345221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:34.352649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9dac1a08-a65a-49b9-afaf-8888faa89cf9 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.163831 Jun 29 16:13:34.353205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 285/550] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:34 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:34.928510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:34.929109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:34.935477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:34.935948 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:34.936693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:34.937117 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:35.066720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:35.074604 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a394686-1bfe-43bb-9d23-7030faf3c4f4 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.150021 Jun 29 16:13:35.075158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 266/551] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:34 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:35.369811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:35.370419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:35.376731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:35.377170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:35.377917 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:35.378346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:35.503078 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:35.511049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-15ec1630-eed2-4671-9b01-0e2dc8485753 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.145616 Jun 29 16:13:35.511601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 286/552] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:35 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:36.092421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:36.093055 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:36.099480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:36.100072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:36.100956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:36.101381 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:36.227195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:36.235060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d2a7f181-7d28-464f-8f1b-a56ccf75e702 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.147142 Jun 29 16:13:36.235584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 267/553] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:36 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:36.528151 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:36.528754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:36.534778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:36.535220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:36.535985 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:36.536412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:36.664668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:36.671929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b625a9ab-4f04-45d2-943a-96a22ea5d34c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.148697 Jun 29 16:13:36.672480 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 287/554] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:36 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:37.252085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:37.252724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:37.259112 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:37.259556 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:37.260335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:37.260764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:37.385762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:37.393066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91290b8d-9191-443e-845f-ba3a45b7d559 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.145157 Jun 29 16:13:37.393616 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 268/555] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:37 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:37.688466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:37.689064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:37.695008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:37.695426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:37.696196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:37.696621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:37.820856 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:37.828630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1baeed8f-4f4c-464e-b735-2beb8ae4007c tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.143958 Jun 29 16:13:37.829181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 288/556] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:37 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:38.409979 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:38.410517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:38.418045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:38.419399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:38.420209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:38.420640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:38.845056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:38.845687 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:38.851872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:38.852317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:38.853281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:38.853804 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:38.894682 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:38.904070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45121ee9-08c3-4e23-8b5a-358ad6bafd2f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.497974 Jun 29 16:13:38.914115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 269/557] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:38 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:38.990858 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:38.998931 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-99be7d48-f54f-4724-8bff-53e15d909071 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.157670 Jun 29 16:13:38.999502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 289/558] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:38 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:39.400233 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a073b214-d416-42ff-9997-5f2249c86ff5 req-ccc385bd-1230-46b6-9db1-76b789a74f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:39.411334 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a073b214-d416-42ff-9997-5f2249c86ff5 req-ccc385bd-1230-46b6-9db1-76b789a74f3c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:39.411982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a073b214-d416-42ff-9997-5f2249c86ff5 req-ccc385bd-1230-46b6-9db1-76b789a74f3c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:39.427588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a073b214-d416-42ff-9997-5f2249c86ff5 req-ccc385bd-1230-46b6-9db1-76b789a74f3c service nova] Creating event network-changed:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:13:39.433129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a073b214-d416-42ff-9997-5f2249c86ff5 req-ccc385bd-1230-46b6-9db1-76b789a74f3c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036617 Jun 29 16:13:39.433725 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 270/559] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:39.922053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:39.922657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:39.928696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:39.929133 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:39.929885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:39.930323 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:40.016135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:40.016826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:40.023032 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:40.023470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:40.024242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:40.024668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:40.057706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:40.065371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fb317a96-aac3-48a6-9aae-0429b3d9642a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.147097 Jun 29 16:13:40.065944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 290/560] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:39 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:40.155776 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:40.163292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d3009f4-af7b-4014-8ccf-8d7d9fa7f6e2 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1315 microversion: 2.1 time: 0.151356 Jun 29 16:13:40.163893 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 271/561] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:40 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:41.082750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:41.083440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:41.090107 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.090496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.091318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.091751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.186092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:41.187433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:41.194093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.194538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.195300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.195729 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.233444 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:41.240943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d49881f8-97f0-4aeb-9955-ad2b1ca3549e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.162182 Jun 29 16:13:41.241500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 291/562] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:41 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:41.327454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:41.334923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d20cb79-9551-408c-a185-7102fff9b4cc tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1465 microversion: 2.1 time: 0.159081 Jun 29 16:13:41.335482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 272/563] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:41 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:41.374350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:41.374838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:41.381093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.381531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.382272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.382694 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.407060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:13:41.488203 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-405ad452-5c50-485f-a6b6-54f33dbfba28 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 204 len: 0 microversion: 2.1 time: 0.117298 Jun 29 16:13:41.488777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 292/564] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:13:41 2022] DELETE /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:13:41.497078 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:41.497687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:41.504014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.504468 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.505226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:41.505661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:41.634509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:41.642398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-589f5958-1f56-4498-b2af-183a0f66f392 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1471 microversion: 2.1 time: 0.149455 Jun 29 16:13:41.642955 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 273/565] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:41 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:42.258247 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:42.258953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:42.265552 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:42.265996 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:42.266756 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:42.267185 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:42.396629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:42.404631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-78cf46c1-755d-4938-bc80-5af9b8c1c487 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.150728 Jun 29 16:13:42.405194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 293/566] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:42 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:42.661488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:42.662010 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:42.668482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:42.668920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:42.669658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:42.670084 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:42.796788 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:42.804034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5899dade-0963-4b57-b5f9-f6e6fed53be7 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1471 microversion: 2.1 time: 0.146338 Jun 29 16:13:42.804581 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 274/567] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:42 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:43.421982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:43.422592 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:43.428627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:43.429067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:43.429814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:43.430243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:43.433039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:43.561845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:43.569293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6f551046-1b14-46e3-829d-1439c1c68eb3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.151228 Jun 29 16:13:43.569850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 294/568] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:43 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:43.821329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:43.821948 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:43.828944 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:43.829392 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:43.830144 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:43.830577 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:43.958595 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:43.966577 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0498ad62-d026-4495-98b7-32f2364ac741 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1471 microversion: 2.1 time: 0.149097 Jun 29 16:13:43.967131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 275/569] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:43 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:44.585971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:44.586618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:44.592740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:44.593190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:44.593949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:44.594385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:44.723285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:44.731272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d9aee2a0-8928-4978-a286-75053e4686f2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.149134 Jun 29 16:13:44.731853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 295/570] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:44 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:44.983832 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:44.984455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:44.990839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:44.991278 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:44.992043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:44.992468 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:45.007122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:45.125192 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:45.133014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9059f11f-ee51-4a05-a8f6-d1ec0060ab43 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1471 microversion: 2.1 time: 0.153107 Jun 29 16:13:45.133580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 276/571] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:44 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:45.748548 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:45.749166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:45.755369 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:45.755813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:45.756597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:45.757030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:45.884084 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:45.892150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8ee7afa3-13a2-4c2d-9bb3-b02a3b7b09b2 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.147953 Jun 29 16:13:45.892703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 296/572] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:45 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:46.149410 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:46.150029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:46.156632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:46.157082 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:46.157834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:46.158269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:46.292435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:46.300077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6fbbc2ba-f357-4aa3-99f4-f4f934630485 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1471 microversion: 2.1 time: 0.154520 Jun 29 16:13:46.300640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 277/573] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:46 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:46.376483 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-a199c7a7-0c0f-4c43-86fa-e9fc220e351c req-973c5151-1409-4df7-ac9a-1650c25f0826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "name": "network-vif-plugged", "status": "completed", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:46.388858 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-a199c7a7-0c0f-4c43-86fa-e9fc220e351c req-973c5151-1409-4df7-ac9a-1650c25f0826 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:46.390891 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-a199c7a7-0c0f-4c43-86fa-e9fc220e351c req-973c5151-1409-4df7-ac9a-1650c25f0826 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:46.408068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-a199c7a7-0c0f-4c43-86fa-e9fc220e351c req-973c5151-1409-4df7-ac9a-1650c25f0826 service nova] Creating event network-vif-plugged:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:13:46.416811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-a199c7a7-0c0f-4c43-86fa-e9fc220e351c req-973c5151-1409-4df7-ac9a-1650c25f0826 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044346 Jun 29 16:13:46.418649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 297/574] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:46.908871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:46.909472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:46.915457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:46.915931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:46.916684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:46.917110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:47.113670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:47.121237 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-57a68986-6689-4814-a2cd-2794584aef56 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.216272 Jun 29 16:13:47.121796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 278/575] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:46 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:47.298196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-75a375e8-241e-4e72-be8d-e60ac76482f9 req-05b3bc9a-7fd0-4483-9d7c-db65630db984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba61073-5fc9-411d-8ee6-66146a5d4500", "name": "network-vif-deleted", "tag": "4d3af398-2c01-4b9f-acc8-c2cd7fd37ddd"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:47.307705 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-75a375e8-241e-4e72-be8d-e60ac76482f9 req-05b3bc9a-7fd0-4483-9d7c-db65630db984 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:47.308165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-75a375e8-241e-4e72-be8d-e60ac76482f9 req-05b3bc9a-7fd0-4483-9d7c-db65630db984 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:47.318057 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:47.318659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:47.321300 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-75a375e8-241e-4e72-be8d-e60ac76482f9 req-05b3bc9a-7fd0-4483-9d7c-db65630db984 service nova] Creating event network-vif-deleted:4d3af398-2c01-4b9f-acc8-c2cd7fd37ddd for instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 on hv-cinder-84814 Jun 29 16:13:47.326817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-75a375e8-241e-4e72-be8d-e60ac76482f9 req-05b3bc9a-7fd0-4483-9d7c-db65630db984 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Jun 29 16:13:47.327375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:47.327532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 298/576] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:47.328179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:47.328987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:47.329456 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:47.394258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:47.404598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d7e9d785-3dae-4e8d-9493-7c84861996ff tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1429 microversion: 2.1 time: 0.090396 Jun 29 16:13:47.405186 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 279/577] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:47 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:48.140249 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:48.140949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:48.147213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:48.147654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:48.148431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:48.148858 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:48.275568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:48.282931 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9b636296-d38c-4204-84a6-d679c0e0976a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1358 microversion: 2.1 time: 0.147766 Jun 29 16:13:48.283486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 299/578] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:48 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:48.423294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:48.424251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:48.433428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:48.433864 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:48.434603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:48.435030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:48.464369 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:48.464802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:48.465233 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lazy-loading 'fault' on Instance uuid 1ba61073-5fc9-411d-8ee6-66146a5d4500 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:13:48.505367 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10438d22afcd45e8a6cb8fb5b119c4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5175c3cc5ca74d07883332f918ca6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:48.512720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ccaa6d70-1d86-4597-a644-3c877bdccb08 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 200 len: 1305 microversion: 2.1 time: 0.094453 Jun 29 16:13:48.513280 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 280/579] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:48 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:49.300106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:49.300706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:49.306708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.307139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.307897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.308318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.437252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:49.445154 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-24a9774b-a42f-4576-bfd3-f02aefc9e819 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1548 microversion: 2.1 time: 0.148750 Jun 29 16:13:49.445809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 300/580] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:49 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:13:49.462517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:49.463125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:49.469658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.470101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.470886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.471317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.529603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:49.530238 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] [instance: 1ba61073-5fc9-411d-8ee6-66146a5d4500] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:49.536248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.536691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.537437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.537867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.551296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] HTTP exception thrown: Instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 could not be found. Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Request method failure captured: Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 HTTP/1.1 Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHoYyDEKTFdSFEr1Nb7aUU8apoc6ewLqiABsF3ypAL6x8xF0JX3UqwZcJp-dPSOep3oa414lHfw0K3HzvcRueuYSP_5VtYW7PDyKn2u9YKEvp48jsfkdwlcNJWrl_BfREPWwXWN8Wcjqua8U-iwhkA_7Z9AsOCGUtv1tiI6g5W7k5gg Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 5175c3cc5ca74d07883332f918ca6403 Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesNegativeTest-775841210 Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:13:49.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5175c3cc5ca74d07883332f918ca6403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5175c3cc5ca74d07883332f918ca6403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5175c3cc5ca74d07883332f918ca6403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5175c3cc5ca74d07883332f918ca6403", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesNegativeTest-775841210 Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 5175c3cc5ca74d07883332f918ca6403 Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesNegativeTest-775841210 Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesNegativeTest-775841210-project Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 10438d22afcd45e8a6cb8fb5b119c4db Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesNegativeTest-775841210-project Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 could not be found. Jun 29 16:13:49.554448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '1ba61073-5fc9-411d-8ee6-66146a5d4500'} Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 could not be found. Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:13:49.555737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 could not be found. Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 could not be found. Jun 29 16:13:49.557567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:13:49.562732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] Returning 404 to user: Instance 1ba61073-5fc9-411d-8ee6-66146a5d4500 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:13:49.562732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9dae5fdd-64e0-4121-ba2f-e51196775170 tempest-VolumesNegativeTest-775841210 tempest-VolumesNegativeTest-775841210-project] 10.222.0.47 "GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500" status: 404 len: 111 microversion: 2.1 time: 0.028753 Jun 29 16:13:49.562732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 301/581] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:49 2022] GET /compute/v2.1/servers/1ba61073-5fc9-411d-8ee6-66146a5d4500 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 16:13:49.608771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:49.616226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c4719c30-65f1-4e7b-b9cb-8a71098a4944 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1548 microversion: 2.1 time: 0.157526 Jun 29 16:13:49.616777 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 281/582] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:49 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:49.632875 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:49.636951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:49.637648 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Searching by: {'deleted': False, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993'} {{(pid=117728) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 29 16:13:49.644297 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.644737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.645524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.645952 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.747466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.multi_cell_list [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117728) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 29 16:13:49.848464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-86ac9a79-c82d-4951-89eb-83d529223e60 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219322 Jun 29 16:13:49.849180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 302/583] 10.222.0.47 () {58 vars in 1124 bytes} [Wed Jun 29 16:13:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:49.859573 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:49.860195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:49.867083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.867549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:49.868351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:49.868767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:50.007129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:13:50.014463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a669d6c0-e682-4c1f-841c-7351611f7ece tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1548 microversion: 2.1 time: 0.158634 Jun 29 16:13:50.015385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 282/584] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:13:49 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:13:51.569254 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea921415-ec94-46fe-bef1-13ca67c5383d"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:13:51.570306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:51.576681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:51.577127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:51.577878 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:51.578299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:51.920895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d384e4af-f5cf-42dc-a4ec-c47a80f60474 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355598 Jun 29 16:13:51.921529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 303/585] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:13:51 2022] POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:13:58.665758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:13:58.666349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:13:58.668802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=52 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:58.673976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:58.674420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:58.675169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:13:58.675598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:13:58.700416 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d2c8e4c-3663-4d2f-a405-a82a0496ffde tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/ips" status: 200 len: 152 microversion: 2.20 time: 0.038517 Jun 29 16:13:58.700978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 283/586] 10.222.0.47 () {60 vars in 1288 bytes} [Wed Jun 29 16:13:58 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:14:00.092405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:00.096643 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:00.097238 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:00.099012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:00.104732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:00.105190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:00.105947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:00.106380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:00.130450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f8de6685-2f37-44a5-94a1-1b3df7a87d57 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/ips" status: 200 len: 150 microversion: 2.1 time: 0.039521 Jun 29 16:14:00.131101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 304/587] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:14:00 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:00.538054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:00.538666 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:00.545388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:00.545834 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:00.546704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:00.547132 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:00.679522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:00.687365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-260e5328-9719-4f02-af07-c3025913e130 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1594 microversion: 2.1 time: 0.153086 Jun 29 16:14:00.688044 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 284/588] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:00 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:00.798730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:00.799319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:00.805738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:00.806185 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:00.806941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:00.807376 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:00.829206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lazy-loading 'flavor' on Instance uuid 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:14:01.093110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cb90503e-a248-43e9-b3bb-f466604bf631 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/action" status: 202 len: 0 microversion: 2.20 time: 0.298106 Jun 29 16:14:01.094035 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 305/589] 10.222.0.47 () {62 vars in 1318 bytes} [Wed Jun 29 16:14:00 2022] POST /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:14:01.102248 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:01.103071 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:01.110011 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:01.110537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:01.111540 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:01.112077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:01.330391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:01.338325 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:01.339964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:01.341120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c50fb086-b78d-4363-90ee-4902b7edcfa3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.242897 Jun 29 16:14:01.341676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 285/590] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:01 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:01.487695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7b5d32c-06e3-4dfb-b281-841306c5c138"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:01.488866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:01.495857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:01.496303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:01.497055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:01.497482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:01.510574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:01.511066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:01.517897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:01.518350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:01.519121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:01.519549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:01.545794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ddfa0edc-1369-4f4c-8a61-bfe4da953dec tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/ips" status: 200 len: 146 microversion: 2.1 time: 0.038200 Jun 29 16:14:01.545794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 286/591] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:14:01 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:14:01.785812 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-21ddf529-fca1-4b5f-acdf-3bba381f1eca tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303127 Jun 29 16:14:01.791135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 306/592] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:14:01 2022] POST /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:02.360600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:02.361095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:02.367121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:02.367558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:02.368514 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:02.368955 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:02.575094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:02.582929 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:02.584443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:02.585606 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-809b2b3a-dced-48b1-9561-2981e45f6b83 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.229022 Jun 29 16:14:02.586155 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 287/593] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:02 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:02.774138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-fa5ca85c-c9c3-468d-b7b2-bd9e892b8db6 req-f722ae38-7ec4-48a1-a150-539b1bd8b4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:02.783355 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-fa5ca85c-c9c3-468d-b7b2-bd9e892b8db6 req-f722ae38-7ec4-48a1-a150-539b1bd8b4c4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:02.783796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-fa5ca85c-c9c3-468d-b7b2-bd9e892b8db6 req-f722ae38-7ec4-48a1-a150-539b1bd8b4c4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:02.795516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-fa5ca85c-c9c3-468d-b7b2-bd9e892b8db6 req-f722ae38-7ec4-48a1-a150-539b1bd8b4c4 service nova] Creating event network-changed:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:14:02.800620 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-fa5ca85c-c9c3-468d-b7b2-bd9e892b8db6 req-f722ae38-7ec4-48a1-a150-539b1bd8b4c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030947 Jun 29 16:14:02.803991 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 307/594] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:03.606161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:03.606948 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:03.614188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:03.614637 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:03.615414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:03.615865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:03.773092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:03.782529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:03.784288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:03.785871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7af39aaa-7286-4f8e-8e4f-e4cf40a16b96 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.184396 Jun 29 16:14:03.786646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 288/595] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:03 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:14:04.087463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1042294707"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:04.088984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:04.095846 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.096504 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:04.097341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.097782 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:04.450704 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.network.security_group_api [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Adding security group 1aeb7a3e-35b0-429d-8a01-523dcd4f8a19 to port 088f3460-37f2-4382-b202-500be881304d Jun 29 16:14:04.810564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:04.811382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:04.818345 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.818785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:04.819566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.820023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:04.857412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-32cad393-20d0-431e-9d67-03bd93b93fbd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/action" status: 202 len: 0 microversion: 2.1 time: 0.777454 Jun 29 16:14:04.862225 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 308/596] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:14:04 2022] POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 16:14:04.867702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-1606bfeb-eb4e-4f73-b7e8-e9c659e79509 req-1ea50ea4-879e-4c18-9cb7-dd795c15ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:04.886334 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-1606bfeb-eb4e-4f73-b7e8-e9c659e79509 req-1ea50ea4-879e-4c18-9cb7-dd795c15ee73 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.886987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-1606bfeb-eb4e-4f73-b7e8-e9c659e79509 req-1ea50ea4-879e-4c18-9cb7-dd795c15ee73 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:04.895168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:04.908977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-1606bfeb-eb4e-4f73-b7e8-e9c659e79509 req-1ea50ea4-879e-4c18-9cb7-dd795c15ee73 service nova] Creating event network-changed:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:14:04.917795 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-1606bfeb-eb4e-4f73-b7e8-e9c659e79509 req-1ea50ea4-879e-4c18-9cb7-dd795c15ee73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053667 Jun 29 16:14:04.918611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 309/597] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:04.929774 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:04.930480 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:04.938441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.938893 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:04.939816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:04.940273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:05.053928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:05.067285 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:05.069241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:05.076505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-317c976b-2d86-4d5a-89c1-c71373ccc587 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.267195 Jun 29 16:14:05.078097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 289/598] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:04 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:14:05.151675 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:05.161615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d57a77b8-0999-491e-b02b-677bb7ed0aec tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1759 microversion: 2.1 time: 0.236365 Jun 29 16:14:05.162187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 310/599] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:04 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1759 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:05.304438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0b9bbba-5660-4067-8d8e-02ee308883db"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:05.306784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:05.315649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:05.316196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:05.317031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:05.317693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:05.644396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0369059c-352f-48f0-95f0-619d95abe535 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344712 Jun 29 16:14:05.645165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 290/600] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:14:05 2022] POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:06.096374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:06.097021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:06.103467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:06.103957 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:06.104773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:06.105744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:06.231052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:06.238947 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:06.240496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:06.241635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5a5c50b2-0c8a-4e86-b524-5439a2e923c9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.149070 Jun 29 16:14:06.242182 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 311/601] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:06 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:07.259324 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:07.260053 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:07.266767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:07.267216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:07.267998 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:07.268432 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:07.399192 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:07.407713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:07.409289 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:07.410423 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1a2c8c61-33e3-41e1-bb30-e19a6878d02e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.155369 Jun 29 16:14:07.410977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 291/602] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:07 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:08.429274 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:08.429825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:08.436272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:08.436718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:08.437477 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:08.437906 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:08.563345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:08.571363 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:08.572915 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:08.574589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a90c44b0-33ff-4ae1-bbe8-3a0799a326a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.148960 Jun 29 16:14:08.575135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 312/603] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:08 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:09.358647 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-719c6012-b47e-44b8-a187-c10c360f12fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: .version_select at 0x7f0434e6b940>, body: {"keypair": {"name": "tempest-keypair-311848783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZi0g/5xw60wRvWYZkYViaBj+whccagNH6skidKLe3X5xee2leShCwAX6/DxDUagk3zrk8pB/0y6OVrZ71zFn8FttbDapzAVFHBi4CJMnn3btGomaa1CmhFh9T0BsFHsA=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:09.373328 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-719c6012-b47e-44b8-a187-c10c360f12fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:14:09.377323 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-719c6012-b47e-44b8-a187-c10c360f12fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:14:09.400922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-719c6012-b47e-44b8-a187-c10c360f12fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046613 Jun 29 16:14:09.401484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 292/604] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:14:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:09.593621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:09.594232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:09.600875 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:09.601318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:09.602070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:09.602498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:09.736097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:09.744399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:09.745896 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:09.747101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1150d62e-e39c-43a1-bbc3-d88853753ad0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.157956 Jun 29 16:14:09.747699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 313/605] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:09 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:10.583830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1371265664", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d31a991-2d95-49d3-82c4-03bcb2a7b773"}], "security_groups": [{"name": "tempest-securitygroup--496719958"}], "key_name": "tempest-keypair-311848783", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:10.684428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] validate_networks() for [('1d31a991-2d95-49d3-82c4-03bcb2a7b773', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:14:10.766262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:10.766863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:10.773374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:10.773826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:10.774590 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:10.775021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:10.911233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:10.926203 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:10.930924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:10.932125 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d7010cf8-a408-464a-8ab5-d6d5f0f081d9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.169720 Jun 29 16:14:10.932680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 314/606] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:10 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:14:11.065161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:14:11.065586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:14:11.066060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:14:11.066520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:14:11.066935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:14:11.076294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:11.076743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:11.077578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:11.078016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:11.085232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:11.099343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:14:11.103327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:14:11.115019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:14:11.117334 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:14:11.162309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63f937cf-b747-4e8f-ab45-e0e973184c0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.583283 Jun 29 16:14:11.162875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 293/607] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:14:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:14:11.173151 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5768c75a-d33d-47d5-959d-a6e6cfe4d038 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:11.173766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5768c75a-d33d-47d5-959d-a6e6cfe4d038 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:11.225549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5768c75a-d33d-47d5-959d-a6e6cfe4d038 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:11.233094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5768c75a-d33d-47d5-959d-a6e6cfe4d038 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1241 microversion: 2.1 time: 0.063678 Jun 29 16:14:11.233652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 315/608] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:11 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:11.951995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:11.952598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:11.959183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:11.959645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:11.960420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:11.960939 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:12.098393 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:12.106342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:12.107914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:12.109094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eab2de34-82ee-480c-bb10-47e1bc2578be tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.162514 Jun 29 16:14:12.109634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 294/609] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:11 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:12.249639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:12.250244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:12.257088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:12.257531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:12.258279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:12.258710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:12.321084 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:12.329245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8be53b1b-ba8b-4ed3-8ebd-6ee23095ebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1301 microversion: 2.1 time: 0.083916 Jun 29 16:14:12.329811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 316/610] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:12 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:13.127378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:13.128716 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:13.136068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:13.136518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:13.137832 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:13.138266 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:13.346772 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:13.347371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:13.354023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:13.354474 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:13.355229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:13.355970 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:13.356086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:13.364269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:13.365837 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:13.367023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49ead86a-ac68-4f82-b2b1-91d871b70846 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.243829 Jun 29 16:14:13.367800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 295/611] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:13 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:13.490014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:13.498139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a42731d4-a66a-4dd0-970e-467d7022c056 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.155291 Jun 29 16:14:13.498703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 317/612] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:13 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:13.737648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-30cfa316-f6d8-4855-b042-a39952a29f02 req-59ff0a5c-2033-4935-bf17-33a551cc32ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb19a48e-3146-4a11-9534-d8ccf44270de", "tag": "59460a83-c451-4099-ac42-020251991bbd"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:13.760355 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-30cfa316-f6d8-4855-b042-a39952a29f02 req-59ff0a5c-2033-4935-bf17-33a551cc32ca service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:13.762064 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-30cfa316-f6d8-4855-b042-a39952a29f02 req-59ff0a5c-2033-4935-bf17-33a551cc32ca service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:13.774342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-30cfa316-f6d8-4855-b042-a39952a29f02 req-59ff0a5c-2033-4935-bf17-33a551cc32ca service nova] Creating event network-changed:59460a83-c451-4099-ac42-020251991bbd for instance cb19a48e-3146-4a11-9534-d8ccf44270de on hv-cinder-84814 Jun 29 16:14:13.780698 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-30cfa316-f6d8-4855-b042-a39952a29f02 req-59ff0a5c-2033-4935-bf17-33a551cc32ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055609 Jun 29 16:14:13.782159 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 296/613] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:14.386034 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:14.386565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:14.392955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:14.393393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:14.394131 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:14.394556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:14.516096 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:14.516819 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:14.520391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:14.523556 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:14.524039 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:14.524799 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:14.525230 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:14.528937 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:14.530432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:14.531565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-90feb727-ac1f-4b28-a4cb-0cd62493affb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.149465 Jun 29 16:14:14.532139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 318/614] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:14 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:14.885220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:14.892422 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ebc06bb9-2270-4658-b093-74deade2b89b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.381027 Jun 29 16:14:14.892978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 297/615] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:14 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:15.550124 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:15.550727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:15.557215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:15.557661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:15.558453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:15.559529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:15.682625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:15.690485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:15.692013 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:15.693152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4089e72c-725f-4736-9cb8-3958c3ceb08e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.146897 Jun 29 16:14:15.693711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 319/616] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:15 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:15.909731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:15.910330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:15.916733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:15.917178 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:15.917927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:15.919015 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:16.045906 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:16.053203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e77d752c-4511-453a-8b60-0940c913a496 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.147443 Jun 29 16:14:16.053755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 298/617] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:15 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:16.711459 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:16.712156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:16.719386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:16.719849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:16.720610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:16.721042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:16.851618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:16.860179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:16.861696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:16.862978 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-44d5bd02-6d3d-4b56-bd01-12daa40e1563 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.155796 Jun 29 16:14:16.863530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 320/618] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:16 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:17.069612 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:17.070205 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:17.077044 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:17.077484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:17.078227 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:17.078654 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:17.206881 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:17.214157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e48224da-0f5d-4b61-8458-e05b7bb74d24 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.148352 Jun 29 16:14:17.214708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 299/619] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:17 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:17.883169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:17.883773 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:17.890311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:17.890759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:17.891519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:17.891983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:18.031796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:18.039670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:18.041262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:18.042433 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-187526a3-1d9e-4c4a-857b-962b6a0cd3e4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.163149 Jun 29 16:14:18.042984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 321/620] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:17 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:18.231546 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:18.232182 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:18.238760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:18.239256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:18.239985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:18.240418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:18.370576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:18.378255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33516d02-8595-4bfc-9454-81d915f7ccad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.151229 Jun 29 16:14:18.378991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 300/621] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:18 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:19.061545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:19.062141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:19.068583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:19.069022 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:19.069758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:19.070189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:19.201615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:19.209500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:19.211030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:19.212190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-71f58883-c232-4203-b41b-2f38faf39d92 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.155134 Jun 29 16:14:19.212742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 322/622] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:19 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:19.395840 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:19.396551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:19.403605 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:19.404175 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:19.405022 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:19.405444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:19.539414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:19.548317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9aa667cf-14bc-40e1-ab9f-0b369a825fcc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.156285 Jun 29 16:14:19.559087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 301/623] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:19 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:20.230176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:20.231390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:20.237992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.238439 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.239194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.239627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.365100 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:20.372923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:20.374431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:20.375576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5661fd4f-7c0d-496d-ad1d-68a78b8f483c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.149313 Jun 29 16:14:20.376166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 323/624] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:20 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:20.509055 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6f7d24b7-0c57-48b4-add1-dd8e1e7b892a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:20.516633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f7d24b7-0c57-48b4-add1-dd8e1e7b892a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.517071 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f7d24b7-0c57-48b4-add1-dd8e1e7b892a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.565826 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:20.566444 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:20.572961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.573402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.574180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.575135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.576017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6f7d24b7-0c57-48b4-add1-dd8e1e7b892a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Going to try to stop instance {{(pid=117727) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 16:14:20.618796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6f7d24b7-0c57-48b4-add1-dd8e1e7b892a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action" status: 202 len: 0 microversion: 2.1 time: 0.113468 Jun 29 16:14:20.619678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 302/625] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:14:20 2022] POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:14:20.628573 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:20.629270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:20.636700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.637784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.638660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:20.639098 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:20.704533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:20.712119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-afb2ec18-6d13-4e4d-b40f-b662b94e3986 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.150322 Jun 29 16:14:20.712681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 324/626] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:20 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:20.772515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:20.781105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a5c4e0c-1c52-4647-9c7c-222fefae0936 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.156877 Jun 29 16:14:20.781655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 303/627] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:20 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:21.394220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:21.394827 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:21.396948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:21.402728 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.403176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.403978 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.404440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.425219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d10de8b6-34e7-4fbf-8a55-ac27dc0a8341 req-042a7c12-c2d9-42d0-9f33-bfffcf6f1dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb19a48e-3146-4a11-9534-d8ccf44270de", "name": "network-vif-plugged", "status": "completed", "tag": "59460a83-c451-4099-ac42-020251991bbd"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:21.429034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:21.429901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:21.437120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d10de8b6-34e7-4fbf-8a55-ac27dc0a8341 req-042a7c12-c2d9-42d0-9f33-bfffcf6f1dc1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.437700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d10de8b6-34e7-4fbf-8a55-ac27dc0a8341 req-042a7c12-c2d9-42d0-9f33-bfffcf6f1dc1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.453034 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d10de8b6-34e7-4fbf-8a55-ac27dc0a8341 req-042a7c12-c2d9-42d0-9f33-bfffcf6f1dc1 service nova] Creating event network-vif-plugged:59460a83-c451-4099-ac42-020251991bbd for instance cb19a48e-3146-4a11-9534-d8ccf44270de on hv-cinder-84814 Jun 29 16:14:21.458763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d10de8b6-34e7-4fbf-8a55-ac27dc0a8341 req-042a7c12-c2d9-42d0-9f33-bfffcf6f1dc1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036671 Jun 29 16:14:21.459552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 304/628] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:14:21.546113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:21.554180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:21.555682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:21.556857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7c247743-a025-4b18-80fe-ca54a7866c1b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.166635 Jun 29 16:14:21.557441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 325/629] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:21 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:21.729973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:21.730664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:21.737927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.738367 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.739111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.739535 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.799019 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:21.799668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:21.805944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.806462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.807213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:21.807643 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:21.871621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:21.879391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4211fb26-47ef-4638-a286-d695873b8cad tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.153572 Jun 29 16:14:21.879989 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 305/630] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:21 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:21.940943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:21.948763 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e00622a0-c867-42e3-99a4-037401096a51 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.153761 Jun 29 16:14:21.949318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 326/631] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:21 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:22.575817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:22.576428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:22.582413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:22.582850 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:22.583591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:22.584041 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:22.708169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:22.715987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:22.717480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:22.718627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6fc8c384-efea-451f-a25a-54f28775d81d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.147231 Jun 29 16:14:22.719177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 306/632] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:22 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:22.896976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:22.897611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:22.904150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:22.904589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:22.905331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:22.905755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:22.921409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:22.966475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:22.967088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:22.973648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:22.974093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:22.974843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:22.975273 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:23.039818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:23.047679 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-56ff73c6-dea1-45c6-b5aa-1df3c2da7ea8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1366 microversion: 2.1 time: 0.154565 Jun 29 16:14:23.048353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 327/633] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:22 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:23.109723 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:23.117757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ecf877a-4b7f-40ff-81f4-2f5a01a673c8 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.155277 Jun 29 16:14:23.118317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 307/634] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:22 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:23.736578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:23.737210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:23.743195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:23.743637 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:23.744422 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:23.744847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:23.923535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:23.934368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:23.936593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:23.937734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-82d24bdd-50ce-4dba-a3e9-4db2d9bab445 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.205050 Jun 29 16:14:23.938600 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 328/635] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:23 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:24.067170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:24.067923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:24.074810 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.075257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.076733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.077167 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.134825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:24.135424 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:24.141972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.142400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.143143 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.143569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.212436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:24.220083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9837c137-121a-4ad5-ba07-56d94c9e655f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1555 microversion: 2.1 time: 0.156936 Jun 29 16:14:24.220658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 308/636] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:24 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:24.236862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:24.237343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:24.243389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.243856 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.244688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.245115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.275413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:24.283458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-473c8e42-6e84-4427-8bb7-14e963cc4015 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.152439 Jun 29 16:14:24.284064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 329/637] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:24 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:24.321655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03cc7f5f-9c05-4ee3-b05a-c1f3206321c0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088483 Jun 29 16:14:24.322239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 309/638] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:14:24 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:14:24.956799 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:24.957437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:24.963838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.964296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:24.965052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:24.965510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:25.093572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:25.101568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:25.103132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:25.104380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3ab978df-fe8b-4b86-bd76-61c55f9a2cfe tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.151526 Jun 29 16:14:25.105010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 330/639] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:24 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:14:25.224736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-01de4aac-fc7c-48bc-beb3-a92074fee1de req-757db30d-b571-4d4f-b63c-22b45d753adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb19a48e-3146-4a11-9534-d8ccf44270de", "tag": "59460a83-c451-4099-ac42-020251991bbd"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:25.232879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-01de4aac-fc7c-48bc-beb3-a92074fee1de req-757db30d-b571-4d4f-b63c-22b45d753adb service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:25.233318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-01de4aac-fc7c-48bc-beb3-a92074fee1de req-757db30d-b571-4d4f-b63c-22b45d753adb service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:25.244300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-01de4aac-fc7c-48bc-beb3-a92074fee1de req-757db30d-b571-4d4f-b63c-22b45d753adb service nova] Creating event network-changed:59460a83-c451-4099-ac42-020251991bbd for instance cb19a48e-3146-4a11-9534-d8ccf44270de on hv-cinder-84814 Jun 29 16:14:25.249104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-01de4aac-fc7c-48bc-beb3-a92074fee1de req-757db30d-b571-4d4f-b63c-22b45d753adb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028523 Jun 29 16:14:25.249855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 310/640] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:25.300841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:25.301444 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:25.307523 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:25.308263 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:25.309031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:25.309463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:25.456069 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:25.464879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1e93c2ea-ce7a-49e3-824f-cb48d2086077 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.167677 Jun 29 16:14:25.465636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 331/641] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:25 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:25.760985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-bf5967ef-55d9-4ede-a03c-a1a55eca7a5c req-0580b41b-43ed-43bd-886d-90284c1ce3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "name": "network-vif-plugged", "status": "completed", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:25.769297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-bf5967ef-55d9-4ede-a03c-a1a55eca7a5c req-0580b41b-43ed-43bd-886d-90284c1ce3db service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:25.769736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-bf5967ef-55d9-4ede-a03c-a1a55eca7a5c req-0580b41b-43ed-43bd-886d-90284c1ce3db service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:25.781465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-bf5967ef-55d9-4ede-a03c-a1a55eca7a5c req-0580b41b-43ed-43bd-886d-90284c1ce3db service nova] Creating event network-vif-plugged:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:14:25.786430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-bf5967ef-55d9-4ede-a03c-a1a55eca7a5c req-0580b41b-43ed-43bd-886d-90284c1ce3db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029403 Jun 29 16:14:25.787100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 311/642] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:26.122453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:26.123111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:26.129926 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:26.130379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:26.131140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:26.131575 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:26.263349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:26.271454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:26.273010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:26.274166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f779c205-840a-4889-b406-d7f2feb0ce2d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.155587 Jun 29 16:14:26.274718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 332/643] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:26 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:26.483948 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:26.484770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:26.491359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:26.491788 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:26.492591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:26.493021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:26.511200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:26.633342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:26.641373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-97709320-c29a-4ad7-bcab-ff63bd979782 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.162703 Jun 29 16:14:26.641921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 312/644] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:26 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:27.292783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:27.293389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:27.299980 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:27.300432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:27.301186 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:27.301621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:27.434993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:27.442921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:27.444460 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:27.445593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b464c87c-f792-499f-83d0-f7b255404d1a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1745 microversion: 2.20 time: 0.156749 Jun 29 16:14:27.446140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 333/645] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:27 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:27.659120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:27.659733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:27.666715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:27.667171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:27.667963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:27.668385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:27.818985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:27.827273 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2daa8c56-202e-4e07-8e83-50a295aba578 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.172810 Jun 29 16:14:27.831883 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 313/646] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:27 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:28.465943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:28.467674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:28.474421 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:28.475093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:28.476119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:28.476555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:28.656472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:28.666614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:28.668606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:28.670203 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-364faf70-a9c5-4175-a4b8-8926050afd41 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.208504 Jun 29 16:14:28.672164 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 334/647] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:28 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:28.846976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:28.847583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:28.849903 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:28.855241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:28.855897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:28.856917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:28.857350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:29.017219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:29.025765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74e55314-4ce4-4d14-b99b-5b95b80b6098 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.182811 Jun 29 16:14:29.026786 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 314/648] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:28 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:29.699249 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:29.701357 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:29.708073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:29.708619 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:29.709614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:29.710373 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:29.848676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:29.858967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:29.860643 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:29.862095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d5be210d-a4f7-4242-bb1b-226be2e23042 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.166665 Jun 29 16:14:29.862540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 335/649] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:29 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:30.043971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:30.044683 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:30.054186 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:30.054710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:30.055577 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:30.056086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:30.203892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:30.213521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ef18c52-d968-4ddc-bab2-784f6006487c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.173647 Jun 29 16:14:30.214919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 315/650] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:30 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:30.880940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:30.881651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:30.885291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=66 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:30.889271 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:30.889797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:30.890724 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:30.891291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:31.040801 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:31.049296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:31.050796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:31.051982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4a1859c5-26be-4339-abc2-e507523ba300 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.175158 Jun 29 16:14:31.052876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 336/651] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:30 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:31.236708 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:31.239086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:31.256754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:31.257857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:31.259599 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:31.260732 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:31.445141 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:31.454261 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3f5fe86a-75b2-4c01-9045-df78ebdbd553 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.226022 Jun 29 16:14:31.454828 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 316/652] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:31 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:32.074842 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:32.078650 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:32.088212 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:32.090393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:32.091955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:32.092844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:32.242379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:32.254402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:32.255962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:32.257138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5a5c1029-b418-4b6d-a248-71cb24949650 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.190856 Jun 29 16:14:32.257697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 337/653] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:32 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:32.472847 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:32.474078 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:32.481057 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:32.481584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:32.482999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:32.483586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:32.625619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:32.634200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ea249877-f9a3-420d-ad32-dc58b803b450 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.165149 Jun 29 16:14:32.634762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 317/654] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:32 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:33.276452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:33.277701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:33.284852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:33.285297 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:33.286056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:33.286486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:33.424641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:33.434324 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:33.436408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:33.437592 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ec2445f2-4d77-4a8e-9f21-1df180e7ad0c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.165675 Jun 29 16:14:33.438159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 338/655] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:33 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:33.651784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:33.655420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:33.678377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:33.678854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:33.679637 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:33.680087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:33.848562 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:33.857442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0d154018-061b-4b77-82ce-41e9451aa81b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.210079 Jun 29 16:14:33.858444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 318/656] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:33 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:34.457221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:34.457776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:34.464702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:34.465434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:34.466824 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:34.467258 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:34.629781 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:34.642092 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:34.643729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:34.644894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d686d3dc-24d6-4eb3-9a92-1af9171ce76f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.192030 Jun 29 16:14:34.645439 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 339/657] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:34 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:34.874461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:34.875065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:34.882371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:34.882816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:34.883566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:34.884019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:35.039099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:35.047865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-77fa1314-8d16-4b3e-9352-dae82bf3790c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.177016 Jun 29 16:14:35.057553 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 319/658] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:34 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:35.664607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:35.665491 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:35.673140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:35.673665 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:35.674517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:35.675021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:35.827648 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:35.835688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:35.837717 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:35.838916 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-84230d26-fba7-479a-8731-4541abf43beb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.178293 Jun 29 16:14:35.839686 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 340/659] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:35 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:36.066492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:36.067248 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:36.073359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:36.073811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:36.079403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:36.079403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:36.253920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:36.268530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fde7d9e1-b4e0-47f5-85c5-43f8aacccf77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1725 microversion: 2.1 time: 0.207064 Jun 29 16:14:36.269107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 320/660] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:36 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:36.858081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:36.858653 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:36.865134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:36.865575 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:36.866327 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:36.866749 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:37.019625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:37.028229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:37.029755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:37.030955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-54fa96cc-e4c5-42f4-9a92-4ab5433390ab tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.177010 Jun 29 16:14:37.031500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 341/661] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:36 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:37.285694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:37.286408 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:37.292686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:37.293187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:37.293953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:37.294889 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:37.431785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:37.440372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f192b634-ccd4-4a9a-a85b-4855ec8ea489 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1702 microversion: 2.1 time: 0.158538 Jun 29 16:14:37.440957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 321/662] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:37 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:37.457224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e2f0b95b-3e4c-48b4-8079-3a88f7006f7f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:37.463661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e2f0b95b-3e4c-48b4-8079-3a88f7006f7f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:37.464142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e2f0b95b-3e4c-48b4-8079-3a88f7006f7f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:37.532975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e2f0b95b-3e4c-48b4-8079-3a88f7006f7f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Going to try to start instance {{(pid=117728) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 16:14:37.579148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e2f0b95b-3e4c-48b4-8079-3a88f7006f7f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action" status: 202 len: 0 microversion: 2.1 time: 0.125585 Jun 29 16:14:37.580059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 342/663] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:14:37 2022] POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:14:37.589588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:37.590076 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:37.598020 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:37.598494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:37.599741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:37.600355 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:37.745209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:37.753539 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-67bf8edf-cb21-4cca-863c-d778bc6da348 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1711 microversion: 2.1 time: 0.169226 Jun 29 16:14:37.754031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 322/664] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:37 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:14:38.050615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:38.051311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:38.057677 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:38.058130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:38.058890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:38.059329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:38.063916 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:38.193407 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:38.201877 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:38.203395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:38.204575 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cc6903cc-ecdc-4af9-825c-8dca0a2a4e1d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1740 microversion: 2.20 time: 0.158675 Jun 29 16:14:38.205134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 343/665] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:38 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:38.770364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:38.771029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:38.777518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:38.777873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:38.778623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:38.779044 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:39.194231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:39.202825 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-62ca24f4-1e43-40a2-9c2a-27bc094eb201 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1711 microversion: 2.1 time: 0.436267 Jun 29 16:14:39.203389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 323/666] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:38 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1711 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:39.223158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:39.223757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:39.230239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:39.230674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:39.231421 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:39.231903 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:39.359491 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:39.367512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:39.369036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:39.370182 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3b5616d7-733f-4f17-bb2b-ae68f4272321 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1722 microversion: 2.20 time: 0.151159 Jun 29 16:14:39.370731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 344/667] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:39 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:40.220117 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:40.220756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:40.227146 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:40.227591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:40.228386 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:40.228818 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:40.359189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:40.367370 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-378c6bde-8540-4ba4-adb3-c9bbe33b3e88 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1715 microversion: 2.1 time: 0.151163 Jun 29 16:14:40.368127 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 324/668] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:14:40 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:14:40.388623 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:40.389227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:40.395625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:40.396107 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:40.396856 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:40.397286 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:40.526877 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:40.534591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:40.536106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:40.537291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3d94774b-a9fe-4340-93dc-44cb8c8b7768 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1722 microversion: 2.20 time: 0.152593 Jun 29 16:14:40.537844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 345/669] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:40 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:41.474914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d182fef7-8602-4c5e-8415-2dbe8e755fd9 req-253615e1-1fdf-4f15-8e43-7adff67c3fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "name": "network-vif-unplugged", "status": "completed", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:41.483923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d182fef7-8602-4c5e-8415-2dbe8e755fd9 req-253615e1-1fdf-4f15-8e43-7adff67c3fc4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:41.484369 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d182fef7-8602-4c5e-8415-2dbe8e755fd9 req-253615e1-1fdf-4f15-8e43-7adff67c3fc4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:41.497321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d182fef7-8602-4c5e-8415-2dbe8e755fd9 req-253615e1-1fdf-4f15-8e43-7adff67c3fc4 service nova] Creating event network-vif-unplugged:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:14:41.502848 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d182fef7-8602-4c5e-8415-2dbe8e755fd9 req-253615e1-1fdf-4f15-8e43-7adff67c3fc4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031126 Jun 29 16:14:41.503433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 325/670] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:14:41.557442 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:41.558564 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:41.566241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:41.566678 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:41.567430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:41.567875 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:41.697006 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:41.705504 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:41.706979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:41.708132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e090eea1-d5eb-4b3c-ba86-8a7937c6e7a4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1722 microversion: 2.20 time: 0.157630 Jun 29 16:14:41.708672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 346/671] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:41 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:42.727751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:42.728462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:42.735629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:42.736096 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:42.736840 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:42.737286 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:42.863735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:42.871485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:42.873011 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:42.874147 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6906f6a-542a-4983-bbb2-f323d7afafc3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1665 microversion: 2.20 time: 0.150654 Jun 29 16:14:42.874693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 326/672] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:42 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:42.891615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf6676e-b00f-47e3-9e04-0809d93ab88e"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:42.892811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:42.899408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:42.899876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:42.900624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:42.901053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:43.349506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3126cf1c-13c9-4c8f-a660-54ed4ec9045f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.461798 Jun 29 16:14:43.350098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 347/673] 10.222.0.47 () {62 vars in 1363 bytes} [Wed Jun 29 16:14:42 2022] POST /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments => generated 188 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:14:43.462504 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:43.463066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:43.469221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:43.469638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:43.470388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:43.470818 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:43.556855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3e036dbd-8fa9-455f-9e56-27d60f48e8a5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/action" status: 202 len: 0 microversion: 2.20 time: 0.098075 Jun 29 16:14:43.557378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 327/674] 10.222.0.47 () {62 vars in 1318 bytes} [Wed Jun 29 16:14:43 2022] POST /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:14:43.566269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:43.567147 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:43.574050 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:43.574503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:43.575270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:43.576360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:43.711137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:43.719510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:43.721165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:43.722320 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3428ca3e-51e1-472b-8929-20567851b43c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1751 microversion: 2.20 time: 0.160307 Jun 29 16:14:43.722883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 348/675] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:43 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:44.741412 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:44.742113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:44.748811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:44.749257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:44.750006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:44.750431 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:44.927514 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:44.929808 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:44.937499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:44.939004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:44.940186 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49f10533-fd29-4b9d-9fc1-30bc465aaa0a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1753 microversion: 2.20 time: 0.203134 Jun 29 16:14:44.940739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 328/676] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:44 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:45.958436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:45.959030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:45.965506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:45.965940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:45.967345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:45.967770 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:46.097608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:46.105944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:46.107453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:46.108621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-86830031-3c0f-4dd8-8239-d1e9b05b41dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.154048 Jun 29 16:14:46.109168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 349/677] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:45 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:47.127222 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:47.128212 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:47.137228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:47.138053 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:47.139301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:47.139977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:47.285886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:47.296331 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:47.298104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:47.299266 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2bbd2544-50d0-4bc1-b074-fc7d92afeb4f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.176586 Jun 29 16:14:47.299843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 329/678] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:47 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:48.318087 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:48.318695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:48.325334 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:48.325785 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:48.326539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:48.326975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:48.459998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:48.469309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:48.471135 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:48.472432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5d95020a-edb1-4b11-b315-f30a28c5a5de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.158340 Jun 29 16:14:48.472992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 350/679] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:48 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:49.490490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:49.491129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:49.498060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:49.498506 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:49.499242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:49.499665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:49.641879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:49.655735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:49.657257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:49.658396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0d8ac9b6-37b0-4441-a22d-9b6394c7c862 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.171835 Jun 29 16:14:49.658941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 330/680] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:49 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:50.676744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:50.677377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:50.683848 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:50.684301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:50.685048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:50.685475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:50.818561 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:50.827210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:50.829364 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:50.830642 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e75f896e-8e3d-42ef-818c-a890a222fae3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.157749 Jun 29 16:14:50.839870 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 351/681] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:50 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:14:51.849679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:51.850297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:51.857042 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:51.857494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:51.858256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:51.858715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:52.010025 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:52.018867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:52.020402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:52.021552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0c70d949-665a-4363-b6e1-daffb0daf697 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.175808 Jun 29 16:14:52.022110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 331/682] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:51 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:53.044164 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:53.044903 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:53.051340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:53.051780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:53.052563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:53.052993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:53.193431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:53.202042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:53.204165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:53.205314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a85e899e-7aa6-4e69-9680-d5c4b8f3ccf9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.168379 Jun 29 16:14:53.205862 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 352/683] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:53 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:54.223961 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:54.224605 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:54.231267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:54.231723 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:54.232524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:54.232959 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:54.366403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:54.374660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:54.376192 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:54.377384 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c1aca3bc-6584-4fbc-b760-fdf01dae4f7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.157955 Jun 29 16:14:54.378220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 332/684] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:54 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:55.395802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:55.396438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:55.402872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:55.403319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:55.404095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:55.404533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:55.551341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:55.561382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:55.563054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:55.565837 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fd77994a-64d2-4b97-adf7-12ddc8eadd8d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.172279 Jun 29 16:14:55.565837 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 353/685] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:55 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:56.694346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:56.694979 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:56.701231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:56.701674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:56.702432 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:56.702864 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:56.839932 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:56.848610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:56.850081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:56.851231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a16139c-923d-4c3e-a615-c7958efdd602 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.272132 Jun 29 16:14:56.857346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 333/686] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:56 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:14:57.129680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d895b8a-9675-4207-b8e3-bc823f359f3c"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:14:57.130806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:57.137934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:57.138656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:57.140267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:57.140853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:57.869665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:57.870274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:57.876845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:57.877293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:57.878350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:57.878782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:58.018347 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:58.026769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:58.028303 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:58.029444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6d14489-b9eb-4815-81bf-acb1354fb4dc tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.163721 Jun 29 16:14:58.030000 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 334/687] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:57 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:14:59.046539 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:14:59.047213 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:14:59.050213 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=44 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:59.056136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:59.056585 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:59.057427 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:14:59.057766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:14:59.184232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:59.192938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:59.194420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:14:59.195553 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c9c896ac-ec7a-4a63-ac42-25ba1c35950d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.152995 Jun 29 16:14:59.196129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 335/688] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:14:59 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:15:00.213713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:00.214348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:00.220923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:00.221366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:00.222114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:00.222540 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:00.358221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:00.366679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:00.368274 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:00.369475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b633e02d-7866-4260-8245-6315f569c029 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.159663 Jun 29 16:15:00.370026 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 336/689] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:00 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:15:01.387196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:01.387873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:01.394853 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:01.395292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:01.396078 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:01.396509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:01.521315 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:01.529643 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:01.531149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:01.532333 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-14890610-095f-4ea2-87b7-b7e71e8fd90b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.148970 Jun 29 16:15:01.532886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 337/690] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:01 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:15:02.549962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:02.550613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:02.559056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:02.559505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:02.560300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:02.560744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:02.750045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:02.759131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:02.761202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:02.762358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26a01b80-ce6b-4942-8133-cfe8f825b3f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.216308 Jun 29 16:15:02.762912 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 338/691] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:02 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:15:02.859335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e26f0dd1-dda2-42b6-9b47-a388715b9a20 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.734390 Jun 29 16:15:02.860110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 354/692] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:14:57 2022] POST /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments => generated 194 bytes in 5736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:15:03.780981 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:03.781585 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:03.788663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:03.789107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:03.789852 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:03.790289 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:03.919515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:03.928168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:03.929659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:03.930839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a9ef0cc5-6a7d-4c88-9cd3-ceea046329fb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.153753 Jun 29 16:15:03.931385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 339/693] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:03 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:04.951306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:04.952506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:04.956094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=38 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:04.964025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:04.964548 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:04.965323 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:04.965754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:05.098793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:05.101052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:05.108943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:05.110411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:05.111550 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d1b65427-f384-4342-ba7f-4517142f16ce tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.166507 Jun 29 16:15:05.112115 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 355/694] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:04 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:06.129353 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:06.129954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:06.136292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:06.136730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:06.137472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:06.137899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:06.266700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:06.275091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:06.276611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:06.277741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a589e505-5d41-4832-9ddc-c9b153f131ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.152548 Jun 29 16:15:06.278346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 340/695] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:06 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:07.296374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:07.296977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:07.304931 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:07.305384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:07.306148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:07.306583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:07.434368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:07.442643 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:07.444187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:07.445337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d6be55fa-c010-49d7-a2c0-f1bd2183812f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.152881 Jun 29 16:15:07.445895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 356/696] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:07 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:08.462925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:08.463459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:08.470365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:08.470807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:08.471557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:08.472019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:08.597631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:08.606415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:08.607926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:08.609071 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0daac466-cdda-4bfc-8c48-f4f39982314d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.150065 Jun 29 16:15:08.609625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 341/697] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:08 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:09.626657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:09.627251 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:09.634572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:09.635014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:09.635754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:09.636207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:09.761343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:09.769695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:09.771214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:09.772386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3a786c40-5adf-487e-876b-df75b649a2d1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.149603 Jun 29 16:15:09.772934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 357/698] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:09 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:10.789499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:10.790365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:10.796887 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:10.797327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:10.798083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:10.798499 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:10.928735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:10.937108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:10.938613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:10.939761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3491de52-04ee-4a30-bb83-45887d269d94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.154243 Jun 29 16:15:10.940345 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 342/699] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:10 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:11.958457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:11.959492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:11.965964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:11.966411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:11.967163 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:11.967594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:12.102838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:12.111149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:12.112681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:12.113824 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3aa3efe2-8b78-4bf5-beff-f15bb41e34c6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.159411 Jun 29 16:15:12.114375 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 358/700] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:11 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:13.134378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:13.134983 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:13.141660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.142111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.142861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.143294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.272200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:13.280434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:13.281906 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:13.283043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d7939bb3-24ab-4232-8de9-6625e95137ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.152568 Jun 29 16:15:13.283586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 343/701] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:13 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:13.498091 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:15:13.499018 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:13.505689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.506625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.507360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.507784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.529923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lazy-loading 'flavor' on Instance uuid 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:15:13.653467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-de1303a6-4c41-4efa-8a5e-4ddc6b167a3b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/action" status: 200 len: 32 microversion: 2.1 time: 0.159146 Jun 29 16:15:13.653979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 359/702] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:15:13 2022] POST /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:15:13.663495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:13.664657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:13.671543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.672072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.673135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.673598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.797387 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-48821727-0b39-48b4-8dfd-7f522fc25d1f req-a506a3f1-cdd1-4555-83db-193c1fb357b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "name": "network-vif-plugged", "status": "completed", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:15:13.806662 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-48821727-0b39-48b4-8dfd-7f522fc25d1f req-a506a3f1-cdd1-4555-83db-193c1fb357b1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:13.808328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-48821727-0b39-48b4-8dfd-7f522fc25d1f req-a506a3f1-cdd1-4555-83db-193c1fb357b1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:13.821719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-48821727-0b39-48b4-8dfd-7f522fc25d1f req-a506a3f1-cdd1-4555-83db-193c1fb357b1 service nova] Creating event network-vif-plugged:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:15:13.826532 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-48821727-0b39-48b4-8dfd-7f522fc25d1f req-a506a3f1-cdd1-4555-83db-193c1fb357b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033352 Jun 29 16:15:13.827794 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 360/703] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:15:13.897283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:13.905244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b7f01c57-629d-4567-96de-3fe72ff1d5f8 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.245920 Jun 29 16:15:13.905848 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 344/704] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:13 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:14.303708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:14.304541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:14.310990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:14.311719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:14.312521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:14.313120 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:14.445449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:14.453953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:14.455443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:14.456624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0af3584e-2dfd-4ef6-8f0c-623b49f1f6c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.157763 Jun 29 16:15:14.457176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 361/705] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:14 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:15:14.922509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:14.923027 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:14.929511 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:14.929949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:14.930690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:14.931116 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:14.947606 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:15.114917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:15.122778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7e33f741-a922-492d-9bfb-87cf2f71e8f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.204186 Jun 29 16:15:15.123344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 345/706] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:14 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:15.474348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:15.474958 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:15.481728 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:15.482174 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:15.482929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:15.483363 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:15.608380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:15.617203 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:15.618707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:15.619879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d72e0720-0a0e-43d9-80af-7c230461cb12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.149394 Jun 29 16:15:15.620436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 362/707] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:15 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:16.140879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:16.141478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:16.149124 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:16.149565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:16.150309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:16.150736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:16.283937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:16.292127 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ab664ef5-e6a0-439c-b5b8-6c4073dc1a5f tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.155215 Jun 29 16:15:16.292702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 346/708] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:16 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:15:16.638178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:16.638807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:16.645259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:16.645697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:16.646444 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:16.646880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:16.774159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:16.782470 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:16.784003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:16.785144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8ffae906-b525-4052-9bff-1c358ae28a5d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1809 microversion: 2.20 time: 0.150916 Jun 29 16:15:16.785696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 363/709] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:16 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:17.309877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:17.310481 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:17.317148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:17.317584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:17.319154 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:17.319700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:17.456217 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:17.464719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-521c80f7-03b2-4617-80ee-07c54eb8a2f0 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.159359 Jun 29 16:15:17.465281 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 347/710] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:17 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:17.804169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:17.804776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:17.811329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:17.811774 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:17.812555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:17.812987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:17.940710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:17.950137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:17.951657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:17.952855 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bca8d736-cbcc-49a2-a409-b7b46e657a89 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1796 microversion: 2.20 time: 0.153189 Jun 29 16:15:17.953415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 364/711] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:15:17 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:15:18.481941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:18.482561 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:18.489179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:18.489627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:18.490382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:18.490816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:18.617016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:18.625021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-12e4aa04-b5e4-4b76-821f-28a7961efb2a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.146940 Jun 29 16:15:18.625587 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 348/712] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:18 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:19.642639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:19.643265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:19.649793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:19.650233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:19.650976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:19.651400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:19.783134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:19.798307 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-335dc5d6-1040-4b76-b5a8-3764ba039e69 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.159527 Jun 29 16:15:19.798876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 365/713] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:19 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:20.815757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:20.816389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:20.823437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:20.823914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:20.824661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:20.825089 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:20.953836 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:20.962770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-20d9b396-9369-4d7a-bb73-d6e5bd8d7573 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.150811 Jun 29 16:15:20.963336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 349/714] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:20 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:21.985377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:21.986718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:21.995201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:21.995645 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:21.996440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:21.996869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:22.122731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:22.131314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7702091f-0287-4199-b3fc-1658bd06d568 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.154398 Jun 29 16:15:22.132039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 366/715] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:21 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:23.148685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:23.149287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:23.155795 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:23.156263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:23.157006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:23.157431 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:23.281546 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:23.289288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0c22d23b-f5a7-4f3e-82a7-4973369be140 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.144950 Jun 29 16:15:23.289841 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 350/716] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:23 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:24.306964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:24.307574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:24.314231 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:24.314681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:24.315438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:24.315898 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:24.446206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:24.454098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d1d1bb8e-64a8-423a-b2da-f027d2e797f6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.151667 Jun 29 16:15:24.454653 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 367/717] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:24 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:25.471740 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:25.472326 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:25.479518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:25.480001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:25.480748 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:25.481174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:25.610359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:25.618309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f2e3e026-0ebb-4674-8367-d8b6b90ee4ca tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.150453 Jun 29 16:15:25.618866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 351/718] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:25 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:26.635717 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:26.636347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:26.643189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:26.643631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:26.644405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:26.644833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:26.769716 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:26.777714 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-19a6d51f-7a4c-4bbf-9117-e910264d0692 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.146378 Jun 29 16:15:26.778282 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 368/719] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:26 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:27.795023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:27.795614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:27.803602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:27.804400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:27.805902 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:27.806338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:27.949530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:27.957494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9e49257-ca51-4940-832c-68908af0ff1d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.166333 Jun 29 16:15:27.958046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 352/720] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:27 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:28.974616 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:28.975217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:28.982305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:28.982743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:28.983487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:28.983954 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:29.108987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:29.116817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7fac5528-7eba-4ca6-a02e-f27ddb6184a6 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.146017 Jun 29 16:15:29.117383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 369/721] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:28 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:30.133868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:30.134474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:30.136771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=36 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:30.142091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:30.142537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:30.143292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:30.143753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:30.270811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:30.278601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec94f451-e426-47d4-8338-68ad8151e977 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.148575 Jun 29 16:15:30.279158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 353/722] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:30 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:31.295760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:31.296412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:31.303570 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:31.304052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:31.304849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:31.305272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:31.434528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:31.442315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d00afa52-6f2d-45c0-aeeb-940c5167edbb tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.150368 Jun 29 16:15:31.442862 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 370/723] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:31 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:32.458641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:32.459184 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:32.465617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:32.466058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:32.466809 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:32.467246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:32.594754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:32.604068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd642adc-4a3d-43eb-8e9f-e4b1312e2d2b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.149307 Jun 29 16:15:32.604640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 354/724] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:32 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:33.620402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:33.620990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:33.627469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:33.627941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:33.628688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:33.629117 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:33.632067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:33.757638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:33.765963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-19c5cc68-dd4f-4e52-b96c-059db29162a1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.149395 Jun 29 16:15:33.766519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 371/725] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:33 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:34.783124 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:34.783734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:34.790446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:34.790888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:34.791638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:34.792094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:34.915971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:34.924150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-def3d6cf-14be-4aa6-a554-e12b7461bee4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.144862 Jun 29 16:15:34.924711 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 355/726] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:34 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:35.941725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:35.942331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:35.944695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=34 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:35.950691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:35.951137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:35.951910 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:35.952346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:36.089267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:36.096734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-70e43016-0efa-4cf2-8c74-1e2e9da40df5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.158906 Jun 29 16:15:36.097666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 372/727] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:35 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:37.114242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:37.114913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:37.121597 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:37.122038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:37.122789 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:37.123225 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:37.256568 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:37.265382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60da7ed8-8ccc-4983-a52e-c180f0ff5604 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.155003 Jun 29 16:15:37.266018 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 356/728] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:37 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:38.282362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:38.282960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:38.289496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:38.289932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:38.290673 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:38.291099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:38.414632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:38.422478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-af819cb8-ca64-4aba-9845-093e12505bcf tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.143943 Jun 29 16:15:38.423031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 373/729] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:38 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:39.439586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:39.440213 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:39.446713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:39.447158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:39.447934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:39.448359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:39.578050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:39.585805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03c6ac97-7402-49d2-bcc3-f58a51756ea2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1735 microversion: 2.1 time: 0.150229 Jun 29 16:15:39.586361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 357/730] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:39 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:40.602793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:40.603351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:40.609791 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:40.610233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:40.610984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:40.611412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:40.735110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:40.742881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-874d0902-bb83-4293-b188-12c02efc7b90 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1715 microversion: 2.1 time: 0.144346 Jun 29 16:15:40.743438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 374/731] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:40 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1715 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:40.795440 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:40.795965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:40.802336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:40.802775 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:40.803522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:40.803975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:40.932657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] HTTP exception thrown: Cannot 'detach_volume' instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 while it is in vm_state rescued Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Request method failure captured: Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments/9d895b8a-9675-4207-b8e3-bc823f359f3c HTTP/1.1 Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlXw1Xys1yLNlsVxFpzGFllqOJH4MLqZcWiNaXyWAAyEU8Dgm4FVBsRAlPVamkBLTLYGZSjigNnLlFpOZ-Qrb_KvL-sLmWKrZQLxM3Nqmbey4d0JTFfSmVGFeyQhlKDvOy4Dr54Pv8vxKPRw-pmt5UxyLLEmpM21MEZO_yM8QgB4QM Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:15:40.934270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a410f5a9cef44b39a657b28f6c1772b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 1c00db02926f4d849249c3990fdf8308 Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:15:40.935676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Cannot 'detach_volume' instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 while it is in vm_state rescued Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042', 'id': '9d895b8a-9675-4207-b8e3-bc823f359f3c'} Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:15:40.936424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 while it is in vm_state rescued Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 while it is in vm_state rescued Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:15:40.937794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Returning 409 to user: Cannot 'detach_volume' instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 while it is in vm_state rescued {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:15:40.938982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b55a330b-21ca-4bf0-8d6f-b3a1ef62c81c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments/9d895b8a-9675-4207-b8e3-bc823f359f3c" status: 409 len: 152 microversion: 2.1 time: 0.144289 Jun 29 16:15:40.938982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 358/732] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:15:40 2022] DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments/9d895b8a-9675-4207-b8e3-bc823f359f3c => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 16:15:40.944558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:15:40.945089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:40.951654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:40.952133 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:40.952884 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:40.953314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:41.017841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8259d658-05ef-4c1a-af95-6cc4a1530266 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "POST /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/action" status: 202 len: 0 microversion: 2.1 time: 0.076831 Jun 29 16:15:41.018502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 375/733] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:15:40 2022] POST /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:15:41.026826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:41.027426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:41.034373 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:41.034821 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:41.035580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:41.036050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:41.205726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:41.213583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-daae788e-28d1-482e-9d6e-b7fe028d76d3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1723 microversion: 2.1 time: 0.190837 Jun 29 16:15:41.214143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 359/734] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:41 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:42.231619 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:42.232340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:42.239109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:42.239508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:42.240294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:42.240725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:42.371094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:42.379001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9d232a74-6ba4-4740-8b90-b24b1094674e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1723 microversion: 2.1 time: 0.152060 Jun 29 16:15:42.379811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 376/735] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:42 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:43.396111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:43.396743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:43.403327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:43.403762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:43.404537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:43.404969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:43.533115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:43.541505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-db1471d4-fb07-4634-b413-8bf5d42cb059 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1723 microversion: 2.1 time: 0.148705 Jun 29 16:15:43.542056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 360/736] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:43 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:43.623175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:15:43.624201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:43.630983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:43.631427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:43.632234 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:43.632661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:43.703950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5168599a-c52f-4da9-93cb-de0ab15bf077 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/action" status: 202 len: 0 microversion: 2.1 time: 0.084363 Jun 29 16:15:43.704495 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 377/737] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:15:43 2022] POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:15:43.712456 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:43.713663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:43.719685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:43.720177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:43.720924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:43.721355 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:44.084640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:44.092510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45277803-351b-41a8-bff8-f8597830896b tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1751 microversion: 2.1 time: 0.383843 Jun 29 16:15:44.093068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 361/738] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:43 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1751 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:44.559363 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:44.560091 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:44.566401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:44.566849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:44.567599 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:44.568067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:44.694345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:44.702166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7a1d8e45-895f-40a8-951b-c3c23f0e625b tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1723 microversion: 2.1 time: 0.147629 Jun 29 16:15:44.702715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 378/739] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:44 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:45.109849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:45.110458 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:45.117058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:45.117503 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:45.118254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:45.118685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:45.122535 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:45.294765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:45.303549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34a4cc2c-7696-4926-be89-c38d40a7f1cd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1751 microversion: 2.1 time: 0.197533 Jun 29 16:15:45.304132 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 362/740] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:45 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:45.719146 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:45.719686 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:45.726121 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:45.726568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:45.727316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:45.727746 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:45.859360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:45.867371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-acf1aa10-843f-4155-8575-5bb3499533c3 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1729 microversion: 2.1 time: 0.152175 Jun 29 16:15:45.867982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 379/741] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:45 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:45.883447 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:45.883966 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:45.890288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:45.890728 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:45.891474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:45.891935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:45.971317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2634c8bf-ae74-4789-95d5-097e17153f11 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091732 Jun 29 16:15:45.971968 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 363/742] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:15:45 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:15:46.321290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:46.321924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:46.328544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:46.328989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:46.329745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:46.330177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:46.472494 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:46.481890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cc43180b-e68d-4f32-8617-03c9122f7a1c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.164373 Jun 29 16:15:46.482455 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 380/743] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:46 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:46.884767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-89aaa037-c5a3-40fd-9ed9-a9af743e548f req-ccc334f5-0d71-4d32-99af-8b0a4f5499bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042", "tag": "d0ad8518-66f0-4e4c-94ca-b7954be0243d"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:15:46.892731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-89aaa037-c5a3-40fd-9ed9-a9af743e548f req-ccc334f5-0d71-4d32-99af-8b0a4f5499bf service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:46.893242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-89aaa037-c5a3-40fd-9ed9-a9af743e548f req-ccc334f5-0d71-4d32-99af-8b0a4f5499bf service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:46.904829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-89aaa037-c5a3-40fd-9ed9-a9af743e548f req-ccc334f5-0d71-4d32-99af-8b0a4f5499bf service nova] Creating event network-changed:d0ad8518-66f0-4e4c-94ca-b7954be0243d for instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 on hv-cinder-84814 Jun 29 16:15:46.910045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-89aaa037-c5a3-40fd-9ed9-a9af743e548f req-ccc334f5-0d71-4d32-99af-8b0a4f5499bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089848 Jun 29 16:15:46.910823 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 364/744] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:15:47.499322 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:47.499962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:47.506895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:47.507345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:47.508127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:47.508559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:47.653572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:47.661711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fa5d1033-5c36-4f98-b195-16361a274dd0 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.166329 Jun 29 16:15:47.662288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 381/745] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:47 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:48.679474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:48.680215 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:48.686425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:48.686864 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:48.687608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:48.688070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:48.825684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:48.833481 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91880936-e690-4475-8bfc-9eec0faba706 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.158677 Jun 29 16:15:48.834026 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 365/746] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:48 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:48.924989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-321c2bbd-3e77-42b5-a9de-24210ecb749b req-bb23d472-0496-4abd-896d-bb3764368fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042", "tag": "d0ad8518-66f0-4e4c-94ca-b7954be0243d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:15:48.933707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-321c2bbd-3e77-42b5-a9de-24210ecb749b req-bb23d472-0496-4abd-896d-bb3764368fb9 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:48.934077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-321c2bbd-3e77-42b5-a9de-24210ecb749b req-bb23d472-0496-4abd-896d-bb3764368fb9 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:48.944683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-321c2bbd-3e77-42b5-a9de-24210ecb749b req-bb23d472-0496-4abd-896d-bb3764368fb9 service nova] Creating event network-changed:d0ad8518-66f0-4e4c-94ca-b7954be0243d for instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 on hv-cinder-84814 Jun 29 16:15:48.949982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-321c2bbd-3e77-42b5-a9de-24210ecb749b req-bb23d472-0496-4abd-896d-bb3764368fb9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028765 Jun 29 16:15:48.950545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 382/747] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:15:49.851072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:49.851687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:49.858753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:49.859200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:49.860203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:49.860648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:50.005100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:50.012858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91faf10f-d7b6-49a2-bdc7-bb80af776f30 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.165607 Jun 29 16:15:50.013436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 366/748] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:49 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:51.031639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:51.032289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:51.038492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:51.038934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:51.039677 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:51.040140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:51.178737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:51.186568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8eee7e61-2cf5-4946-a804-46087481e0ce tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.159678 Jun 29 16:15:51.187119 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 383/749] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:51 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:52.203577 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:52.204208 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:52.210655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:52.211097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:52.211873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:52.212332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:52.354985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:52.368245 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f4ef262b-747e-4fb9-883c-0cf59a2e4e6e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.168386 Jun 29 16:15:52.368819 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 367/750] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:52 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:53.386263 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:53.386767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:53.392862 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:53.393308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:53.394041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:53.394463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:53.535798 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:53.543755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d01f451f-a8a7-44ec-a6d8-e80dd918a4bd tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.162117 Jun 29 16:15:53.544328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 384/751] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:53 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:54.560662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:54.561268 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:54.567689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:54.568155 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:54.568896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:54.569326 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:54.710183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:54.717912 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45490354-a4eb-48a3-9a85-a98eaae3f9f6 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.161567 Jun 29 16:15:54.718457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 368/752] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:54 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:55.735130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:55.735731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:55.742254 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:55.742699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:55.743454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:55.744031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:55.897574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:55.905708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6d181c4f-49c2-4415-baa1-8bf979eef5d8 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1756 microversion: 2.1 time: 0.174427 Jun 29 16:15:55.906272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 385/753] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:55 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:15:56.922988 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:15:56.923587 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:15:56.930154 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:56.930591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:56.931335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:15:56.931817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:15:57.070510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:15:57.079049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7fd9e337-53be-4265-8321-94dda4b7682f tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1759 microversion: 2.1 time: 0.159872 Jun 29 16:15:57.079627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 369/754] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:15:56 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:00.129304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:00.129876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:00.137573 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:00.138019 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:00.138807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:00.139545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:00.191035 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:00.262379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lazy-loading 'services' on Instance uuid 6c82fec7-271e-4a90-82ae-0425c0c53431 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:00.375652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ec9c0e3d-ce2f-47ff-af89-eddff30a9a09 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-volume_attachments/c0b9bbba-5660-4067-8d8e-02ee308883db" status: 202 len: 0 microversion: 2.1 time: 0.352904 Jun 29 16:16:00.376263 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 386/755] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:16:00 2022] DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-volume_attachments/c0b9bbba-5660-4067-8d8e-02ee308883db => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:02.535628 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e432a023-94e6-49a9-a515-5ec6805ead36 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:02.538167 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=34 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:02.544255 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e432a023-94e6-49a9-a515-5ec6805ead36 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:02.544702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e432a023-94e6-49a9-a515-5ec6805ead36 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:02.566765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e432a023-94e6-49a9-a515-5ec6805ead36 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Going to try to stop instance {{(pid=117727) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 16:16:02.607484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e432a023-94e6-49a9-a515-5ec6805ead36 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action" status: 202 len: 0 microversion: 2.1 time: 0.075455 Jun 29 16:16:02.608113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 370/756] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:16:02 2022] POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:02.617184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:02.617970 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:02.624510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:02.625001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:02.625734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:02.626244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:02.754512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:02.762275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-61205447-72f8-4460-b69c-8849a99def78 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.149799 Jun 29 16:16:02.762839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 387/757] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:02 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:03.782028 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:03.782739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:03.788897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:03.789341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:03.790085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:03.790534 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:03.922472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:03.929893 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1c83b74-3f95-4bf3-9b27-4d0463d40fe2 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.152593 Jun 29 16:16:03.930454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 371/758] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:03 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:04.946850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:04.948074 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:04.954631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:04.955070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:04.955841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:04.956282 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:05.088458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:05.095488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ad7fcde7-99d4-46ad-ac3e-6dbbbdd29793 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.152533 Jun 29 16:16:05.096109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 388/759] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:04 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:06.111833 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:06.112457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:06.118692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:06.119135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:06.119963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:06.120398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:06.246113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:06.253420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4bbc7991-c812-4cd6-b825-fbb78cee495b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.145463 Jun 29 16:16:06.253982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 372/760] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:06 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:07.271104 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:07.271634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:07.274033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=34 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:07.280057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:07.280503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:07.281252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:07.281682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:07.406266 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:07.413733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3d229bbb-64be-41fd-80eb-17bfd9ab7b77 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.146580 Jun 29 16:16:07.414284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 389/761] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:07 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:08.430390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:08.430988 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:08.437505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:08.437942 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:08.438685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:08.439112 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:08.566758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:08.574672 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-73095ae3-3609-4723-8243-978d08d872c1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.148160 Jun 29 16:16:08.575218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 373/762] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:08 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:09.591809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:09.592443 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:09.598834 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:09.599275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:09.600046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:09.600472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:09.726514 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:09.734379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d65de36a-4fe0-4220-b89d-e98fc7cde6b7 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.146473 Jun 29 16:16:09.734923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 390/763] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:09 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:10.669469 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:10.669964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:10.675965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.676408 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.677152 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.677582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.700201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3540776c-d111-4cd0-bb1a-e79084bf88c9 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/ips" status: 200 len: 149 microversion: 2.1 time: 0.084068 Jun 29 16:16:10.700739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 374/764] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:16:10 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/ips => generated 149 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:10.711062 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7b5d32c-06e3-4dfb-b281-841306c5c138"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:10.712200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:10.718800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.719246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.720030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.720457 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.751439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:10.751664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:10.757989 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.758435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.759383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.759835 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.799764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Invalid volume: volume d7b5d32c-06e3-4dfb-b281-841306c5c138 is already attached to instances: 5c170b82-196f-4eb1-aee4-915ea0fdbffd Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: POST /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/os-volume_attachments HTTP/1.1 Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 74 Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:16:10.801507 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {"volumeAttachment": {"volumeId": "d7b5d32c-06e3-4dfb-b281-841306c5c138"}} Jun 29 16:16:10.802902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Invalid volume: volume d7b5d32c-06e3-4dfb-b281-841306c5c138 is already attached to instances: 5c170b82-196f-4eb1-aee4-915ea0fdbffd Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'server_id': 'cb19a48e-3146-4a11-9534-d8ccf44270de', 'body': {'volumeAttachment': {'volumeId': 'd7b5d32c-06e3-4dfb-b281-841306c5c138'}}} Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d7b5d32c-06e3-4dfb-b281-841306c5c138 is already attached to instances: 5c170b82-196f-4eb1-aee4-915ea0fdbffd Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:10.803713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d7b5d32c-06e3-4dfb-b281-841306c5c138 is already attached to instances: 5c170b82-196f-4eb1-aee4-915ea0fdbffd Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:10.804953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d7b5d32c-06e3-4dfb-b281-841306c5c138 is already attached to instances: 5c170b82-196f-4eb1-aee4-915ea0fdbffd Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 400 to user: Invalid volume: volume d7b5d32c-06e3-4dfb-b281-841306c5c138 is already attached to instances: 5c170b82-196f-4eb1-aee4-915ea0fdbffd {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2fa0c9c7-3e5e-4931-a47e-e98f68968737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095847 Jun 29 16:16:10.806150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 391/765] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:16:10 2022] POST /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:16:10.812163 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:10.812651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:10.819181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.819624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.820402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.820833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.846586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:16:10.895760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:10.904198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-77c2c1a6-7bc6-4b5b-8535-00bd9d495009 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.156810 Jun 29 16:16:10.905070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 375/766] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:10 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:10.928277 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b7c1e0dd-bc1f-426f-9ebc-5b0f64a6d5e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 204 len: 0 microversion: 2.1 time: 0.119280 Jun 29 16:16:10.929139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 392/767] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:16:10 2022] DELETE /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 16:16:10.937095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:10.937701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:10.943664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.944146 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:10.944897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:10.945329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:11.071773 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:11.079205 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-17427596-cbe4-492c-a661-966650739310 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1680 microversion: 2.1 time: 0.145928 Jun 29 16:16:11.079769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 376/768] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:10 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:11.923505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:11.924271 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:11.930712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:11.931150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:11.932509 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:11.932938 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:12.071003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:12.078486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cb28e892-283f-42a0-99ad-e456d3f9b6ad tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.159805 Jun 29 16:16:12.079046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 393/769] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:11 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:12.096500 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:12.097129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:12.104219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:12.104664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:12.105447 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:12.105907 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:12.234410 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:12.241795 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c2c88b03-3956-4034-bc86-a83604afff0b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1680 microversion: 2.1 time: 0.149111 Jun 29 16:16:12.242365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 377/770] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:12 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:13.094867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:13.095496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:13.102275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:13.102715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:13.104170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:13.104600 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:13.239598 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:13.247066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ba0b87ce-516f-42c8-b502-48c78fd7e8fc tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.156039 Jun 29 16:16:13.247625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 394/771] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:13 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:13.260957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:13.261644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:13.268269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:13.268784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:13.269638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:13.270129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:13.524061 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:13.532241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e1b98425-2326-4c81-94eb-19a5e318a73b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1680 microversion: 2.1 time: 0.274956 Jun 29 16:16:13.532807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 378/772] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:13 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:14.069730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-8dc80666-a5ad-4d74-9ba8-f0371c454943 req-71857a2a-265f-4206-ba75-ddd318121f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb19a48e-3146-4a11-9534-d8ccf44270de", "name": "network-vif-deleted", "tag": "59460a83-c451-4099-ac42-020251991bbd"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:14.078543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-8dc80666-a5ad-4d74-9ba8-f0371c454943 req-71857a2a-265f-4206-ba75-ddd318121f06 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:14.079054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-8dc80666-a5ad-4d74-9ba8-f0371c454943 req-71857a2a-265f-4206-ba75-ddd318121f06 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:14.091039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-8dc80666-a5ad-4d74-9ba8-f0371c454943 req-71857a2a-265f-4206-ba75-ddd318121f06 service nova] Creating event network-vif-deleted:59460a83-c451-4099-ac42-020251991bbd for instance cb19a48e-3146-4a11-9534-d8ccf44270de on hv-cinder-84814 Jun 29 16:16:14.095869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-8dc80666-a5ad-4d74-9ba8-f0371c454943 req-71857a2a-265f-4206-ba75-ddd318121f06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029627 Jun 29 16:16:14.099374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 395/773] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:14.265205 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:14.265716 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:14.272410 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:14.272860 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:14.273657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:14.274119 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:14.277204 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:14.424926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:14.435014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a774178-e4f8-49ff-8662-9e452f6b474b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.174138 Jun 29 16:16:14.436322 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 379/774] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:14 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:14.551598 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:14.552585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:14.559647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:14.560297 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:14.561047 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:14.561477 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:14.592285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:14.592730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:14.593172 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lazy-loading 'fault' on Instance uuid cb19a48e-3146-4a11-9534-d8ccf44270de {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:14.636672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:14.644488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3f1a1772-930d-41ff-b602-db60b4edffe2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 200 len: 1331 microversion: 2.1 time: 0.097704 Jun 29 16:16:14.645084 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 396/775] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:14 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:15.452379 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:15.452901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:15.459424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:15.459911 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:15.460717 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:15.461161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:15.586577 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:15.594560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bca38cfe-3511-498f-a163-68e0af19a4ff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.146200 Jun 29 16:16:15.595129 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 380/776] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:15 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:15.662472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:15.663123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:15.670274 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:15.670724 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:15.671487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:15.671963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:15.685022 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de HTTP/1.1 Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:16:15.686633 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:16:15.688145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': 'cb19a48e-3146-4a11-9534-d8ccf44270de'} Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:16:15.688951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:16:15.690111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:16:15.691194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:16:15.691194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-71839fc5-14d6-4b5e-8132-dd1d9862bce2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 404 len: 111 microversion: 2.1 time: 0.029423 Jun 29 16:16:15.691194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 397/777] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:15 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:16:15.696996 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-795219eb-3d79-41d2-9dbe-19918204c0ab tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '.version_select at 0x7f0434cae4c0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:15.716060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-795219eb-3d79-41d2-9dbe-19918204c0ab tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311848783" status: 202 len: 0 microversion: 2.1 time: 0.022769 Jun 29 16:16:15.716543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 381/778] 10.222.0.47 () {58 vars in 1217 bytes} [Wed Jun 29 16:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311848783 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:16.353963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:16.354475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:16.361606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:16.362046 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:16.362787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:16.363211 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:16.448102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lazy-loading 'services' on Instance uuid 5c170b82-196f-4eb1-aee4-915ea0fdbffd {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:16.519236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ae4cd179-aa15-4df7-9236-d21cfcb031c5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments/d7b5d32c-06e3-4dfb-b281-841306c5c138" status: 202 len: 0 microversion: 2.1 time: 0.168865 Jun 29 16:16:16.519752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 398/779] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:16:16 2022] DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments/d7b5d32c-06e3-4dfb-b281-841306c5c138 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:16.528323 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:16.529386 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:16.536848 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:16.537349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:16.538066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:16.538714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:16.568493 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91c0b694-6bd9-4e8b-a74d-7a5f7d38b8e3 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Jun 29 16:16:16.569048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 382/780] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:16:16 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:16.612288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:16.613097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:16.620445 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:16.621112 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:16.621999 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:16.622300 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:16.760715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:16.768114 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bc3b5df3-e3fb-4a44-aefa-8c60ca1a0949 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.160066 Jun 29 16:16:16.768673 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 399/781] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:16 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:17.580073 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:17.581003 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:17.587543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.588055 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.589330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.589764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.621670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-897fc38a-0a89-4670-883c-481df38cabcb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045462 Jun 29 16:16:17.622245 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 383/782] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:16:17 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:16:17.679355 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:17.679910 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:17.686693 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.687232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.688153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.688613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.713982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:16:17.727530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:17.785630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:17.786388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:17.793221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.793409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fc80c700-236b-4c94-9d55-f0e96676ffc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 204 len: 0 microversion: 2.1 time: 0.117244 Jun 29 16:16:17.793949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 400/783] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:16:17 2022] DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:16:17.794551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.795449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.795849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.802329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:17.803109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:17.809109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.809630 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.810463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:17.810965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:17.935254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:17.942692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71219d51-4ba5-4792-907d-f70ab5d85495 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.160879 Jun 29 16:16:17.943249 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 384/784] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:17 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:17.951239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:17.958822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b7c7e744-a5f4-49c7-b8a8-7e4e7c88f1fe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1682 microversion: 2.1 time: 0.160564 Jun 29 16:16:17.959386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 401/785] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:17 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:18.959700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:18.960338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:18.966931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:18.967390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:18.968243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:18.968674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:18.976334 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:18.976942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:18.983763 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:18.984239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:18.984997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:18.985428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:19.103202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:19.111417 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-62db6a78-b10f-4e87-8370-5b62a9ccf24b tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1679 microversion: 2.1 time: 0.155576 Jun 29 16:16:19.112368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 385/786] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:18 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:19.122800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:19.130320 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3515afc1-0d52-46da-bbf9-452f22ec4a9d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1682 microversion: 2.1 time: 0.157732 Jun 29 16:16:19.131141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 402/787] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:18 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:20.128953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:20.129635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:20.137123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.137637 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.138497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.138926 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.148438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:20.149155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:20.155784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.156288 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.157345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.157780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.287672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:20.295719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-83275ae3-7eaf-4894-9f33-0d4fb519adac tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1682 microversion: 2.1 time: 0.152008 Jun 29 16:16:20.296417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 403/788] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:20 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:20.370465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:20.378057 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c6b2bd92-c88a-482d-b330-be9444a9a854 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1656 microversion: 2.1 time: 0.252941 Jun 29 16:16:20.378619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 386/789] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:20 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1656 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:20.394602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2ba64320-f3ee-4660-bcb1-af32df640ca9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:20.400649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2ba64320-f3ee-4660-bcb1-af32df640ca9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.401097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2ba64320-f3ee-4660-bcb1-af32df640ca9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.423379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2ba64320-f3ee-4660-bcb1-af32df640ca9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Going to try to start instance {{(pid=117728) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 16:16:20.468758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2ba64320-f3ee-4660-bcb1-af32df640ca9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action" status: 202 len: 0 microversion: 2.1 time: 0.077763 Jun 29 16:16:20.469431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 404/790] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:16:20 2022] POST /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:20.477574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:20.478565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:20.485738 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.486335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.487474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:20.487730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:20.782922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:20.790565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9a365b46-bfb9-4718-9ff6-94fc296b760f tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1665 microversion: 2.1 time: 0.316869 Jun 29 16:16:20.791131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 387/791] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:20 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1665 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:21.095940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-3b91c535-4480-49db-bf22-7c9fb9deea51 req-62e07394-e765-4aa1-9aa5-5aa5553361fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c170b82-196f-4eb1-aee4-915ea0fdbffd", "name": "network-vif-deleted", "tag": "f9e596b8-8618-4cee-87b3-79b4c53159ee"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:21.105384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-3b91c535-4480-49db-bf22-7c9fb9deea51 req-62e07394-e765-4aa1-9aa5-5aa5553361fb service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:21.105901 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-3b91c535-4480-49db-bf22-7c9fb9deea51 req-62e07394-e765-4aa1-9aa5-5aa5553361fb service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:21.117211 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-3b91c535-4480-49db-bf22-7c9fb9deea51 req-62e07394-e765-4aa1-9aa5-5aa5553361fb service nova] Creating event network-vif-deleted:f9e596b8-8618-4cee-87b3-79b4c53159ee for instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd on hv-cinder-84814 Jun 29 16:16:21.122757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-3b91c535-4480-49db-bf22-7c9fb9deea51 req-62e07394-e765-4aa1-9aa5-5aa5553361fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Jun 29 16:16:21.123763 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 405/792] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:21.313698 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:21.314938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:21.321514 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:21.321964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:21.322773 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:21.323782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:21.354219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:21.354670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:21.355115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lazy-loading 'fault' on Instance uuid 5c170b82-196f-4eb1-aee4-915ea0fdbffd {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:21.396024 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:21.403610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-295c2505-2823-4a97-ab38-3a8440ad31fc tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 200 len: 1331 microversion: 2.1 time: 0.093868 Jun 29 16:16:21.404214 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 388/793] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:21 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:21.810199 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:21.810900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:21.817303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:21.817753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:21.818521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:21.818959 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:21.952597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:21.961191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4fee3d80-e4eb-4cd8-8356-a34935111ef1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1665 microversion: 2.1 time: 0.156319 Jun 29 16:16:21.961760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 406/794] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:21 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:22.421349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:22.421880 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:22.428337 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:22.428783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:22.429534 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:22.429966 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:22.443859 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd HTTP/1.1 Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:16:22.445444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:16:22.447040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '5c170b82-196f-4eb1-aee4-915ea0fdbffd'} Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:16:22.447973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:16:22.449486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:22.450875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:16:22.450875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aaaacf22-658f-41bb-a8fe-85ec429ba2d1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 404 len: 111 microversion: 2.1 time: 0.029389 Jun 29 16:16:22.450875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 389/795] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:22 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:16:22.455354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4690d84e-34af-456d-bed9-5c3ca7c2b7a6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '.version_select at 0x7f0434b59040>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:22.475419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4690d84e-34af-456d-bed9-5c3ca7c2b7a6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219214197" status: 202 len: 0 microversion: 2.1 time: 0.023640 Jun 29 16:16:22.475997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 407/796] 10.222.0.47 () {58 vars in 1220 bytes} [Wed Jun 29 16:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219214197 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:22.978368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:22.979023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:22.985511 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:22.985950 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:22.986746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:22.987131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:23.085534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-940ef59e-5781-441f-8946-3700b657c6e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: .version_select at 0x7f0434b76550>, body: {"keypair": {"name": "tempest-keypair-1066142199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB71fDRvlTE/OnBV6oQJEwzHWY2SXx+wb2Lx9PPYJ8JfI2rMpRq3LSgUVGWpvzJmt1yLPyuERQtloEilaLR5hinnJuyR2Y+pHGG4difctSVLw0J1gcxJOnkrPCDTMUxnFA=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:23.102536 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-940ef59e-5781-441f-8946-3700b657c6e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:16:23.107102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-940ef59e-5781-441f-8946-3700b657c6e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:16:23.126073 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:23.129246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-940ef59e-5781-441f-8946-3700b657c6e1 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047994 Jun 29 16:16:23.129979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 408/797] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:16:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:23.134750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a087666-d600-47ce-925c-855538a856d6 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1669 microversion: 2.1 time: 0.160087 Jun 29 16:16:23.136158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 390/798] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:22 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:24.559876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1073176574", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d31a991-2d95-49d3-82c4-03bcb2a7b773"}], "security_groups": [{"name": "tempest-securitygroup--1603691489"}], "key_name": "tempest-keypair-1066142199", "user_data": "}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:24.660385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] validate_networks() for [('1d31a991-2d95-49d3-82c4-03bcb2a7b773', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:16:24.920359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:24.921093 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:24.927584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:24.928070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:24.928829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:24.929263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:24.959989 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff23fd1e-626c-4227-9953-3c1797a1c663 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments/faf6676e-b00f-47e3-9e04-0809d93ab88e" status: 200 len: 194 microversion: 2.20 time: 0.044161 Jun 29 16:16:24.960735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 391/799] 10.222.0.47 () {60 vars in 1453 bytes} [Wed Jun 29 16:16:24 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments/faf6676e-b00f-47e3-9e04-0809d93ab88e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:16:25.027694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:25.028301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:25.034983 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:25.035434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:25.036233 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:25.036662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:25.064293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:16:25.064715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:16:25.065184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:16:25.065591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:16:25.066066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:16:25.075114 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:25.075754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:25.077934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:25.078397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:25.096646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:16:25.100706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:16:25.113487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:16:25.115844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:16:25.118191 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lazy-loading 'services' on Instance uuid 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:25.163939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [c7dcae8a-a614-4eae-a9e7-7f18bef8db05] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 16:16:25.231319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f72140ea-1faa-4cc7-9b12-638609e2b10f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments/faf6676e-b00f-47e3-9e04-0809d93ab88e" status: 202 len: 0 microversion: 2.20 time: 0.207978 Jun 29 16:16:25.231930 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 392/800] 10.222.0.47 () {60 vars in 1456 bytes} [Wed Jun 29 16:16:25 2022] DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments/faf6676e-b00f-47e3-9e04-0809d93ab88e => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 16:16:25.240679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:25.241742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:25.248061 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:25.248509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:25.249364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:25.249815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:25.279475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-827794f6-d4f7-4c23-a532-710185a25cdf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042971 Jun 29 16:16:25.280051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 393/801] 10.222.0.47 () {60 vars in 1342 bytes} [Wed Jun 29 16:16:25 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:16:26.172685 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [c7dcae8a-a614-4eae-a9e7-7f18bef8db05] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 48302. Jun 29 16:16:26.176940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b42d173d-1a47-478b-87c7-006618b14358 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.622043 Jun 29 16:16:26.177761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 409/802] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:16:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:16:26.188282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7fa8427d-6a58-4c75-a26e-ba38d3155ef2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:26.189049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7fa8427d-6a58-4c75-a26e-ba38d3155ef2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:26.243630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7fa8427d-6a58-4c75-a26e-ba38d3155ef2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:26.250877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7fa8427d-6a58-4c75-a26e-ba38d3155ef2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1242 microversion: 2.1 time: 0.066435 Jun 29 16:16:26.251425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 394/803] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:26 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:26.290602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:26.292108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:26.298757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:26.299200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:26.299972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:26.300398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:26.328854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9b5daed6-45a2-448e-9fea-a7ee86c0f8f9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042227 Jun 29 16:16:26.329409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 410/804] 10.222.0.47 () {60 vars in 1342 bytes} [Wed Jun 29 16:16:26 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:26.386692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:26.387177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:26.393075 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:26.393513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:26.394257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:26.394683 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:26.419217 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:16:26.466838 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:26.493815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d6a0bee-4fd1-4a8f-85e7-839415dd7532 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 204 len: 0 microversion: 2.20 time: 0.110633 Jun 29 16:16:26.494389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 395/805] 10.222.0.47 () {60 vars in 1279 bytes} [Wed Jun 29 16:16:26 2022] DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 16:16:26.503361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:26.504027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:26.510543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:26.510987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:26.511739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:26.512219 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:26.641106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:26.649196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:26.651435 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:26.652609 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-690b2ba4-1fcd-44e9-9af9-727c85150e9d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.153158 Jun 29 16:16:26.653167 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 411/806] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:26 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:27.268750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91d7f528-45d4-4a69-b5eb-a0cdc759100b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:27.269365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91d7f528-45d4-4a69-b5eb-a0cdc759100b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:27.322493 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91d7f528-45d4-4a69-b5eb-a0cdc759100b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:27.331176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91d7f528-45d4-4a69-b5eb-a0cdc759100b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1242 microversion: 2.1 time: 0.066826 Jun 29 16:16:27.331864 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 396/807] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:27 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:27.672319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:27.672851 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:27.678963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:27.679399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:27.680191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:27.680617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:27.814320 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:27.822534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:27.824188 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:27.825422 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-aff2444b-018a-48fc-b27e-e6b69dc71be0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.157049 Jun 29 16:16:27.826068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 412/808] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:27 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:28.348433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0c329b61-507b-44e3-837d-a1fbe6659fa4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:28.349009 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0c329b61-507b-44e3-837d-a1fbe6659fa4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:28.403216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c329b61-507b-44e3-837d-a1fbe6659fa4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:28.410168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0c329b61-507b-44e3-837d-a1fbe6659fa4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1242 microversion: 2.1 time: 0.065991 Jun 29 16:16:28.410732 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 397/809] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:28 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:28.843692 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:28.844469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:28.850637 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:28.851082 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:28.851843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:28.852376 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:28.984298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:28.992722 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:28.994237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:28.995955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-97efb34b-11bf-4112-bbe4-d24f741efb55 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1724 microversion: 2.20 time: 0.156102 Jun 29 16:16:28.996524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 413/810] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:28 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:29.427743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26eed8d4-b97c-4c83-b23a-c4409d94b740 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:29.428468 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26eed8d4-b97c-4c83-b23a-c4409d94b740 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:29.502101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26eed8d4-b97c-4c83-b23a-c4409d94b740 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:29.509005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26eed8d4-b97c-4c83-b23a-c4409d94b740 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1242 microversion: 2.1 time: 0.086336 Jun 29 16:16:29.509560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 398/811] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:29 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:29.772913 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-508daeb9-3cb8-4be4-b706-e4c34f1d713e req-4bf742d2-470c-45fb-a5ef-6f436ab2bf18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8c3aca-bf52-4212-9953-29cdfc5cc8fe", "name": "network-vif-deleted", "tag": "5714f26e-d432-4693-a476-4391f2f42e43"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:29.784636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-508daeb9-3cb8-4be4-b706-e4c34f1d713e req-4bf742d2-470c-45fb-a5ef-6f436ab2bf18 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:29.785213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-508daeb9-3cb8-4be4-b706-e4c34f1d713e req-4bf742d2-470c-45fb-a5ef-6f436ab2bf18 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:29.800657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-508daeb9-3cb8-4be4-b706-e4c34f1d713e req-4bf742d2-470c-45fb-a5ef-6f436ab2bf18 service nova] Creating event network-vif-deleted:5714f26e-d432-4693-a476-4391f2f42e43 for instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe on hv-cinder-84814 Jun 29 16:16:29.805874 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-508daeb9-3cb8-4be4-b706-e4c34f1d713e req-4bf742d2-470c-45fb-a5ef-6f436ab2bf18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037310 Jun 29 16:16:29.806460 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 414/812] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:16:30.014494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:30.015116 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:30.021119 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:30.021563 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:30.022307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:30.022734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:30.053288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:30.053732 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:30.054165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lazy-loading 'fault' on Instance uuid 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:30.098861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:30.108023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:30.109445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:30.110575 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f731b104-9a68-4d5b-b30e-49e5b5d75bb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 200 len: 1371 microversion: 2.20 time: 0.100015 Jun 29 16:16:30.111123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 399/813] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:30 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:30.528261 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:30.529061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:30.535546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:30.536029 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:30.536796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:30.537228 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:30.605105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:30.612853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-59d7065c-b7d4-47fb-a30e-10210e6ae36c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1246 microversion: 2.1 time: 0.090209 Jun 29 16:16:30.613657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 415/814] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:30 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:31.129659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:31.130265 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:31.137652 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:31.138090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:31.138833 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:31.139257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:31.154429 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] HTTP exception thrown: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Request method failure captured: Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe HTTP/1.1 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlTfUAp6T8VpDotnI7_HkuMq8qO6dqylAKmY2As-JL6p_f-0zdR1gLLHggWun0V0CGn5YMVljRFzhkPrFofW8Myjia3Qj3k_TdK-wZkbgUc3KdixUwtTRUSgooDk8rNm7dey6Gqfin-9am75zpSHR5Kiz3SB7OmvXJAbS1pE5g8MSY Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3910745b858045628982687e473c23b7 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:16:31.156099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3910745b858045628982687e473c23b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3910745b858045628982687e473c23b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3910745b858045628982687e473c23b7 Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: d75d976f2c554209bc4c64d338ad7cf7 Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:16:31.157693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '7c8c3aca-bf52-4212-9953-29cdfc5cc8fe'} Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:16:31.158521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:16:31.159919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:16:31.161211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Returning 404 to user: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:16:31.161211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5ee65c10-68ae-4954-9873-2cc184ac29c3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 404 len: 111 microversion: 2.20 time: 0.031672 Jun 29 16:16:31.161211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 400/815] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:31 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:16:31.166098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f7e67614-f364-4547-acd4-1a20a6c13d4d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '.version_select at 0x7f0434b59dc0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:31.183522 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f7e67614-f364-4547-acd4-1a20a6c13d4d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980448045" status: 204 len: 0 microversion: 2.20 time: 0.021193 Jun 29 16:16:31.184090 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 416/816] 10.222.0.47 () {60 vars in 1261 bytes} [Wed Jun 29 16:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980448045 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 16:16:31.629557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:31.630463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:31.637059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:31.637490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:31.638244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:31.638667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:31.720828 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:31.731272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-98cc1d9f-7b74-45e1-a520-a7d2d7f36139 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1300 microversion: 2.1 time: 0.105307 Jun 29 16:16:31.734220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 401/817] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:31 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:31.834559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f2fbdd04-6e23-4800-bc42-0f88e691c941 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'create', calling method: .version_select at 0x7f0434c7dee0>, body: {"keypair": {"name": "tempest-keypair-1179106913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9rL720UFE9vynp4Irmmz5aW/wONtku9AC6AlApCnbTFRAfLEuebIpK4PfysSgAr9uF+kccTKpGZlSSPEXKG2Gxj/3D+JQZtRk7SmSoE2Fk7zn6OpAwOo6ghOZ9Ym3KfQ=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:31.839835 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:31.856694 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-f2fbdd04-6e23-4800-bc42-0f88e691c941 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for project 3910745b858045628982687e473c23b7. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:16:31.861138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-f2fbdd04-6e23-4800-bc42-0f88e691c941 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for user d75d976f2c554209bc4c64d338ad7cf7 and project 3910745b858045628982687e473c23b7. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:16:31.890555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f2fbdd04-6e23-4800-bc42-0f88e691c941 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058359 Jun 29 16:16:31.896156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 417/818] 10.222.0.47 () {62 vars in 1199 bytes} [Wed Jun 29 16:16:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 29 16:16:32.754294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:32.756059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:32.760986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:32.768735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:32.769609 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:32.770688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:32.771240 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:32.972402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-2513aa0e-50b0-4be5-9e94-9c680b1f3c67 req-4bf649a4-20ec-491d-8907-0b6b180d6128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24be8382-229e-4cea-8504-fa5b22a825a5", "tag": "ccfac2a3-6d43-489e-8f3d-4b3e1727b931"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:32.986639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-2513aa0e-50b0-4be5-9e94-9c680b1f3c67 req-4bf649a4-20ec-491d-8907-0b6b180d6128 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:32.989089 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-2513aa0e-50b0-4be5-9e94-9c680b1f3c67 req-4bf649a4-20ec-491d-8907-0b6b180d6128 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:33.007004 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-2513aa0e-50b0-4be5-9e94-9c680b1f3c67 req-4bf649a4-20ec-491d-8907-0b6b180d6128 service nova] Creating event network-changed:ccfac2a3-6d43-489e-8f3d-4b3e1727b931 for instance 24be8382-229e-4cea-8504-fa5b22a825a5 on hv-cinder-84814 Jun 29 16:16:33.012238 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-2513aa0e-50b0-4be5-9e94-9c680b1f3c67 req-4bf649a4-20ec-491d-8907-0b6b180d6128 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043647 Jun 29 16:16:33.013385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 418/819] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:33.013632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:33.024359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6825c705-912a-46f7-a4ed-57b7f74206f6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.275706 Jun 29 16:16:33.025463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 402/820] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:32 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:33.376301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-695497061", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23d87460-3054-4323-bbfc-60f319d2d13d"}], "security_groups": [{"name": "tempest-securitygroup--2080743100"}], "key_name": "tempest-keypair-1179106913", "user_data": "}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:33.479639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] validate_networks() for [('23d87460-3054-4323-bbfc-60f319d2d13d', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:16:33.845829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:16:33.846247 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:16:33.846712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:16:33.847106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:16:33.847505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:16:33.856174 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:33.856609 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:33.857386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:33.857807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:33.874416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for project 3910745b858045628982687e473c23b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:16:33.878290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Getting quotas for user d75d976f2c554209bc4c64d338ad7cf7 and project 3910745b858045628982687e473c23b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:16:33.889694 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:16:33.891983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:16:33.936465 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2c7baccc-83c1-42d4-9746-0eb8f8ad8f2e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.564991 Jun 29 16:16:33.937326 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 419/821] 10.222.0.47 () {62 vars in 1187 bytes} [Wed Jun 29 16:16:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 16:16:33.946885 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ab608e91-955f-4d96-aeb7-7b904cad76b1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:33.947480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ab608e91-955f-4d96-aeb7-7b904cad76b1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:34.003353 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab608e91-955f-4d96-aeb7-7b904cad76b1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:34.011436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab608e91-955f-4d96-aeb7-7b904cad76b1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:34.012959 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab608e91-955f-4d96-aeb7-7b904cad76b1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:34.014080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ab608e91-955f-4d96-aeb7-7b904cad76b1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1281 microversion: 2.20 time: 0.071017 Jun 29 16:16:34.014692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 403/822] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:33 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:16:34.041716 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:34.042406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:34.048654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:34.049097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:34.049845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:34.050272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:34.188473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:34.196310 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-361acfe7-364a-4bae-895d-9077e197f78f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.158936 Jun 29 16:16:34.197071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 420/823] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:34 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:35.032364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:35.033001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:35.040060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:35.040507 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:35.041259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:35.042297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:35.101077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:35.110517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:35.112058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:35.113153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc8bead5-85e2-4bb0-83db-611ad4d1226c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1285 microversion: 2.20 time: 0.084661 Jun 29 16:16:35.113701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 404/824] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:35 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:35.214745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:35.215282 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:35.221868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:35.222314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:35.223061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:35.223491 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:35.347275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:35.354671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bbea25a3-736e-4d02-a734-9f1759455ccf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.144425 Jun 29 16:16:35.355238 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 421/825] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:35 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:36.131143 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:36.132351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:36.138543 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:36.138993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:36.139762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:36.140221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:36.234239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:36.242933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:36.244522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:36.246216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b46a6440-0fec-404a-a2d4-8ed2ddb96b4c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1277 microversion: 2.20 time: 0.119146 Jun 29 16:16:36.246937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 405/826] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:36 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:36.371714 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:36.372358 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:36.378780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:36.379220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:36.380000 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:36.380438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:36.395195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:36.506531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:36.513960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0ded29e1-45f2-4eab-9646-b7b14f6210f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.146384 Jun 29 16:16:36.514529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 422/827] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:36 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:37.265405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:37.265954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:37.273104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:37.273561 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:37.274330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:37.274768 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:37.346798 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:37.354772 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:37.356293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:37.357387 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3a9772aa-3743-4f02-99a4-f1c7c42a029e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1339 microversion: 2.20 time: 0.095960 Jun 29 16:16:37.357938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 406/828] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:37 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:37.530608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:37.531129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:37.537616 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:37.538068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:37.538820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:37.539249 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:37.683486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:37.705661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a4ba3cd3-0c1d-48d6-a630-8f547ead386e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.178887 Jun 29 16:16:37.706239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 423/829] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:37 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:38.297429 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-bef2b422-ed6f-43de-8f0f-a17732f91571 req-716f3861-7fb5-48e3-84ca-159152dd9210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:38.306662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-bef2b422-ed6f-43de-8f0f-a17732f91571 req-716f3861-7fb5-48e3-84ca-159152dd9210 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:38.307122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-bef2b422-ed6f-43de-8f0f-a17732f91571 req-716f3861-7fb5-48e3-84ca-159152dd9210 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:38.318999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-bef2b422-ed6f-43de-8f0f-a17732f91571 req-716f3861-7fb5-48e3-84ca-159152dd9210 service nova] Creating event network-changed:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:16:38.325413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-bef2b422-ed6f-43de-8f0f-a17732f91571 req-716f3861-7fb5-48e3-84ca-159152dd9210 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031712 Jun 29 16:16:38.326054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 407/830] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:38.374569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:38.375191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:38.382336 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:38.382790 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:38.383563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:38.384048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:38.529211 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:38.537901 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:38.539409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:38.540617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ee729b25-5308-4379-8944-9ece2e98f959 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.169922 Jun 29 16:16:38.541155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 424/831] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:38 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:38.723309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:38.724311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:38.730533 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:38.730991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:38.732407 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:38.732909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:38.865486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:38.873306 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74a98707-692c-4fdc-bf03-7090ad76f786 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.154243 Jun 29 16:16:38.873857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 408/832] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:38 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:39.561267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:39.561865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:39.568458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:39.568895 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:39.569631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:39.570054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:39.698475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:39.706296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:39.707804 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:39.708914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2524c173-90d6-4f0c-8063-2fbb2edfbd85 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.152037 Jun 29 16:16:39.709467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 425/833] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:39 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:39.890230 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:39.891133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:39.897315 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:39.897764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:39.898515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:39.898941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:40.029509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:40.036946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f94b9696-cbae-4e49-acdb-ac2ceb623c5b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.150697 Jun 29 16:16:40.037510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 409/834] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:39 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:40.110583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-88a8ba22-2b94-4d92-8cac-50011ded6c2f req-f0b69412-a768-4003-af5a-f7e4445f7d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24be8382-229e-4cea-8504-fa5b22a825a5", "name": "network-vif-plugged", "status": "completed", "tag": "ccfac2a3-6d43-489e-8f3d-4b3e1727b931"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:40.118715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-88a8ba22-2b94-4d92-8cac-50011ded6c2f req-f0b69412-a768-4003-af5a-f7e4445f7d3e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:40.119156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-88a8ba22-2b94-4d92-8cac-50011ded6c2f req-f0b69412-a768-4003-af5a-f7e4445f7d3e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:40.130213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-88a8ba22-2b94-4d92-8cac-50011ded6c2f req-f0b69412-a768-4003-af5a-f7e4445f7d3e service nova] Creating event network-vif-plugged:ccfac2a3-6d43-489e-8f3d-4b3e1727b931 for instance 24be8382-229e-4cea-8504-fa5b22a825a5 on hv-cinder-84814 Jun 29 16:16:40.135146 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-88a8ba22-2b94-4d92-8cac-50011ded6c2f req-f0b69412-a768-4003-af5a-f7e4445f7d3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085916 Jun 29 16:16:40.135745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 426/835] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:40.726519 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:40.727038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:40.733137 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:40.733584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:40.734338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:40.734774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:40.865418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:40.874239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:40.875817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:40.876922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f1e46ee7-41f6-4d12-abf1-55b581eb3394 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.154395 Jun 29 16:16:40.877462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 410/836] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:40 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:41.054293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:41.054979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:41.061749 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:41.062187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:41.062929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:41.063350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:41.194339 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:41.203676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-124f32cd-9780-4204-87c6-9901396bdafb tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.153980 Jun 29 16:16:41.204335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 427/837] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:41 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:41.895868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:41.896433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:41.903581 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:41.904066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:41.904825 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:41.905260 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:42.161121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:42.169039 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:42.170538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:42.171645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-898d147b-3422-4921-9b30-e85c9abe0c94 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.279850 Jun 29 16:16:42.172234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 411/838] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:41 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:42.220600 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:42.221204 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:42.227656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:42.228126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:42.228861 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:42.229312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:42.353357 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:42.360691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-45a181d7-da02-4340-be3e-a570cd4331a2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.143905 Jun 29 16:16:42.361247 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 428/839] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:42 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:43.194700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:43.195335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:43.202505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:43.202951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:43.203706 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:43.204170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:43.334328 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:43.342278 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:43.343779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:43.344886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f38bb112-5911-4850-ab0c-9c679b1b2753 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.154114 Jun 29 16:16:43.345438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 412/840] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:43 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:43.377157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:43.377764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:43.384492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:43.384935 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:43.386335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:43.386770 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:43.519466 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:43.526960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-65043ec3-0ea4-4ebc-925b-e9155c40347c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1368 microversion: 2.1 time: 0.153607 Jun 29 16:16:43.527544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 429/841] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:43 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:44.058520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-67341bd6-5139-4e01-8b4a-2c835347a82e req-d0f59e6a-69ba-4269-a21f-6919a97426d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "name": "network-vif-plugged", "status": "completed", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:44.062102 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:44.069713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-67341bd6-5139-4e01-8b4a-2c835347a82e req-d0f59e6a-69ba-4269-a21f-6919a97426d2 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.070198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-67341bd6-5139-4e01-8b4a-2c835347a82e req-d0f59e6a-69ba-4269-a21f-6919a97426d2 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.081781 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-67341bd6-5139-4e01-8b4a-2c835347a82e req-d0f59e6a-69ba-4269-a21f-6919a97426d2 service nova] Creating event network-vif-plugged:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:16:44.086858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-67341bd6-5139-4e01-8b4a-2c835347a82e req-d0f59e6a-69ba-4269-a21f-6919a97426d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032030 Jun 29 16:16:44.087620 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 413/842] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:44.362614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:44.363222 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:44.365239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=4 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:44.366063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=20 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:44.371738 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.372202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.372965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.373394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.513333 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:44.521291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:44.522823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:44.523943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2f01941c-2693-47f6-8891-a6080457025f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.165291 Jun 29 16:16:44.524505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 430/843] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:44 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:44.543521 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:44.544334 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:44.551107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.551555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.552369 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.552804 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.683977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:44.691231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4ca20c48-4e20-4bb2-98ff-b9a1ca32b750 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1557 microversion: 2.1 time: 0.152089 Jun 29 16:16:44.691783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 414/844] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:44 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:44.707743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:44.708256 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:44.714220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.714599 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.715343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:44.715776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:44.793196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0addf03f-9c6a-4a3e-8a3f-662b9c82667a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089193 Jun 29 16:16:44.793817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 431/845] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:16:44 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:45.543239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:45.543924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:45.550371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:45.550819 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:45.551591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:45.552049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:45.686207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:45.694457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:45.695977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:45.697149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dac20473-d179-448f-87e1-5aff50370037 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1407 microversion: 2.20 time: 0.158476 Jun 29 16:16:45.697709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 415/846] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:45 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:45.957086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-8f82717e-cda2-44ee-96e5-0b728a21aa72 req-906c3bf9-09de-4234-b35f-523c77cb98d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24be8382-229e-4cea-8504-fa5b22a825a5", "tag": "ccfac2a3-6d43-489e-8f3d-4b3e1727b931"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:45.965662 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-8f82717e-cda2-44ee-96e5-0b728a21aa72 req-906c3bf9-09de-4234-b35f-523c77cb98d4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:45.966096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-8f82717e-cda2-44ee-96e5-0b728a21aa72 req-906c3bf9-09de-4234-b35f-523c77cb98d4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:45.978871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-8f82717e-cda2-44ee-96e5-0b728a21aa72 req-906c3bf9-09de-4234-b35f-523c77cb98d4 service nova] Creating event network-changed:ccfac2a3-6d43-489e-8f3d-4b3e1727b931 for instance 24be8382-229e-4cea-8504-fa5b22a825a5 on hv-cinder-84814 Jun 29 16:16:45.984145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-8f82717e-cda2-44ee-96e5-0b728a21aa72 req-906c3bf9-09de-4234-b35f-523c77cb98d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085624 Jun 29 16:16:45.984816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 432/847] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:46.715649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:46.716278 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:46.723115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:46.723557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:46.724343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:46.724770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:46.932928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:46.942991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:46.944641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:46.945843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-caff36cb-9764-444f-9bd4-4d33844102eb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1600 microversion: 2.20 time: 0.234217 Jun 29 16:16:46.946800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 416/848] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:16:46 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1600 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:16:46.966406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:46.967014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:46.973823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:46.974284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:46.975287 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:46.975922 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:47.211495 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f779a48b-107e-454c-a7bc-2278e4a115c4 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.251002 Jun 29 16:16:47.212207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 433/849] 10.222.0.47 () {60 vars in 1315 bytes} [Wed Jun 29 16:16:46 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:16:48.106879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-55b1e55f-9e75-4a50-9a37-ca20a7940932 req-9dd75218-0457-41ed-8186-522e21de4364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:16:48.115270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-55b1e55f-9e75-4a50-9a37-ca20a7940932 req-9dd75218-0457-41ed-8186-522e21de4364 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:48.115710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-55b1e55f-9e75-4a50-9a37-ca20a7940932 req-9dd75218-0457-41ed-8186-522e21de4364 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:48.126495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-55b1e55f-9e75-4a50-9a37-ca20a7940932 req-9dd75218-0457-41ed-8186-522e21de4364 service nova] Creating event network-changed:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:16:48.131488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-55b1e55f-9e75-4a50-9a37-ca20a7940932 req-9dd75218-0457-41ed-8186-522e21de4364 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028276 Jun 29 16:16:48.132368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 417/850] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:53.363189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:53.363736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:53.369697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:53.370800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:53.371543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:53.372010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:53.450552 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lazy-loading 'services' on Instance uuid 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:16:53.521106 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0de1b7ad-6054-495b-92bf-340081461497 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments/9d895b8a-9675-4207-b8e3-bc823f359f3c" status: 202 len: 0 microversion: 2.1 time: 0.161895 Jun 29 16:16:53.521719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 434/851] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:16:53 2022] DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments/9d895b8a-9675-4207-b8e3-bc823f359f3c => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:16:53.531686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:53.532735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:53.538883 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:53.539328 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:53.540123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:53.540558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:53.567103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:53.572148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-830ec279-6153-466f-8a71-ed131bdb9c83 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 Jun 29 16:16:53.572702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 418/852] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:16:53 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:54.583853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:54.584855 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:54.591842 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:54.592445 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:54.593205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:54.593637 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:54.624302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b016971f-a25c-4744-8ba1-2d2130d853d9 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Jun 29 16:16:54.625068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 435/853] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:16:54 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:16:55.636765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:55.637592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:55.645108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:55.645549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:55.646292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:55.646826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:55.674584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a71e4bef-ec9c-41ad-8b45-fb9742109680 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042764 Jun 29 16:16:55.675110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 419/854] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:16:55 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:16:55.750224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:55.750769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:55.757384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:55.757831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:55.758618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:55.759048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:55.784175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:16:55.859571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3aeb3122-3985-433a-ab5f-f1298306060c tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 204 len: 0 microversion: 2.1 time: 0.112880 Jun 29 16:16:55.860492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 436/855] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:16:55 2022] DELETE /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:16:55.868228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:55.868831 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:55.875287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:55.875725 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:55.876501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:55.876936 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:56.007291 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:56.015679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8aec427c-a053-41a1-be5d-d5682d80e0ac tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1689 microversion: 2.1 time: 0.151394 Jun 29 16:16:56.016483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 420/856] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:55 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:16:57.033248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:57.033986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:57.040533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:57.040975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:57.041717 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:57.042149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:57.170610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:57.178133 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-032770bd-aa8a-42a8-b8d2-089d69158c86 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1689 microversion: 2.1 time: 0.149283 Jun 29 16:16:57.178692 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 437/857] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:57 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:58.194364 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:58.195013 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:58.202122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:58.202560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:58.203295 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:58.203726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:58.333017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:58.340675 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c2b8899a-9b96-4b96-8479-e2d639fe30fc tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1689 microversion: 2.1 time: 0.150111 Jun 29 16:16:58.341176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 421/858] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:58 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:16:59.357391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:16:59.357924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:16:59.364530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:59.364969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:59.365712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:16:59.366140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:16:59.496230 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:16:59.498516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:59.505191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-be41729e-0ad1-472b-946b-286ce21bf356 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1689 microversion: 2.1 time: 0.151763 Jun 29 16:16:59.505747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 438/859] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:16:59 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:00.522726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:00.523329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:00.531567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:00.532367 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:00.533717 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:00.534354 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:00.762829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:00.770249 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc371e81-8bef-4288-9c33-bd465a60e866 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1689 microversion: 2.1 time: 0.251582 Jun 29 16:17:00.770824 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 422/860] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:00 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:17:01.201226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-9533e040-21a0-411c-a939-c4ed9959770d req-0dfcd726-e2b4-4f33-9e64-af2ee5ec4050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042", "name": "network-vif-deleted", "tag": "d0ad8518-66f0-4e4c-94ca-b7954be0243d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:01.213487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-9533e040-21a0-411c-a939-c4ed9959770d req-0dfcd726-e2b4-4f33-9e64-af2ee5ec4050 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:01.213924 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-9533e040-21a0-411c-a939-c4ed9959770d req-0dfcd726-e2b4-4f33-9e64-af2ee5ec4050 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:01.226076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-9533e040-21a0-411c-a939-c4ed9959770d req-0dfcd726-e2b4-4f33-9e64-af2ee5ec4050 service nova] Creating event network-vif-deleted:d0ad8518-66f0-4e4c-94ca-b7954be0243d for instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 on hv-cinder-84814 Jun 29 16:17:01.231325 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-9533e040-21a0-411c-a939-c4ed9959770d req-0dfcd726-e2b4-4f33-9e64-af2ee5ec4050 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Jun 29 16:17:01.232237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 439/861] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:01.610629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1042294707"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:01.611234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:01.618104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:01.618546 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:01.619417 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:01.619870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:01.749896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.network.security_group_api [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Removing security group 1aeb7a3e-35b0-429d-8a01-523dcd4f8a19 from port 088f3460-37f2-4382-b202-500be881304d Jun 29 16:17:01.788666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:01.789854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:01.796606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:01.797061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:01.798144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:01.798594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:01.836621 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:01.837072 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:01.837531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lazy-loading 'fault' on Instance uuid 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:17:01.902882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:01.910378 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ee9c89d9-52ba-4cf6-affd-62723c19f608 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 200 len: 1336 microversion: 2.1 time: 0.126294 Jun 29 16:17:01.920891 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 440/862] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:01 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 1336 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:17:02.135873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aaf31810-a637-43aa-bcf1-8b1b34581cd3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/action" status: 202 len: 0 microversion: 2.1 time: 0.528843 Jun 29 16:17:02.137458 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 423/863] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:17:01 2022] POST /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:17:02.927509 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:02.928243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:02.930570 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:02.935735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:02.936215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:02.936978 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:02.937410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:02.952778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] HTTP exception thrown: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 could not be found. Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Request method failure captured: Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 HTTP/1.1 Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlXw1Xys1yLNlsVxFpzGFllqOJH4MLqZcWiNaXyWAAyEU8Dgm4FVBsRAlPVamkBLTLYGZSjigNnLlFpOZ-Qrb_KvL-sLmWKrZQLxM3Nqmbey4d0JTFfSmVGFeyQhlKDvOy4Dr54Pv8vxKPRw-pmt5UxyLLEmpM21MEZO_yM8QgB4QM Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:17:02.954671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a410f5a9cef44b39a657b28f6c1772b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 1c00db02926f4d849249c3990fdf8308 Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 could not be found. Jun 29 16:17:02.956153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042'} Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 could not be found. Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:17:02.957128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 could not be found. Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 could not be found. Jun 29 16:17:02.958725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:02.960160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Returning 404 to user: Instance 1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:17:02.960160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8df64318-beba-4a79-b605-403abf1e921d tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042" status: 404 len: 111 microversion: 2.1 time: 0.032537 Jun 29 16:17:02.960160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 441/864] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:02 2022] GET /compute/v2.1/servers/1f1cd485-4fd4-42a8-a7ac-f0bbfbc82042 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:02.966593 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a4f1c127-7414-45cf-8b4c-0717ee41b33a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '.version_select at 0x7f0434d391f0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:02.974851 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=46 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:02.987381 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a4f1c127-7414-45cf-8b4c-0717ee41b33a tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335581155" status: 202 len: 0 microversion: 2.1 time: 0.025704 Jun 29 16:17:02.987969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 424/865] 10.222.0.47 () {58 vars in 1220 bytes} [Wed Jun 29 16:17:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335581155 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:17:03.251349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-3c81bebb-c63c-416c-94e0-c075efae7081 req-55e38a1a-d3cc-4ef4-9349-80450f7ef8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:03.261922 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-3c81bebb-c63c-416c-94e0-c075efae7081 req-55e38a1a-d3cc-4ef4-9349-80450f7ef8d4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:03.262361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-3c81bebb-c63c-416c-94e0-c075efae7081 req-55e38a1a-d3cc-4ef4-9349-80450f7ef8d4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:03.276220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-3c81bebb-c63c-416c-94e0-c075efae7081 req-55e38a1a-d3cc-4ef4-9349-80450f7ef8d4 service nova] Creating event network-changed:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:17:03.281832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-3c81bebb-c63c-416c-94e0-c075efae7081 req-55e38a1a-d3cc-4ef4-9349-80450f7ef8d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035185 Jun 29 16:17:03.282480 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 442/866] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:03.553917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:03.557089 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:03.573633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:03.574974 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:03.576171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:03.576862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:03.679258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lazy-loading 'services' on Instance uuid cf9e672c-ee0d-4780-b6b7-f064cf29549c {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:17:03.778742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-890cd858-b18e-4a77-a226-a93143c3c17e tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments/ea921415-ec94-46fe-bef1-13ca67c5383d" status: 202 len: 0 microversion: 2.1 time: 0.235694 Jun 29 16:17:03.779328 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 425/867] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:17:03 2022] DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments/ea921415-ec94-46fe-bef1-13ca67c5383d => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:17:03.788671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:03.789984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:03.798687 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:03.799428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:03.800447 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:03.801875 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:03.857893 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b8dc1fc9-b45a-44e8-945d-aaf7d3a765fa tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072315 Jun 29 16:17:03.859260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 443/868] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:17:03 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:17:04.871793 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:04.873574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:04.881574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:04.882744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:04.884271 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:04.885170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:04.914614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d0cbb21-ef78-47ea-aa04-073d421124ba tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048121 Jun 29 16:17:04.915164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 426/869] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:17:04 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:17:04.925806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:04.926697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:04.935081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:04.935519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:04.936462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:04.936888 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:05.013085 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] HTTP exception thrown: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c is not attached to volume ea921415-ec94-46fe-bef1-13ca67c5383d Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Request method failure captured: Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments/ea921415-ec94-46fe-bef1-13ca67c5383d HTTP/1.1 Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHoHDoW2OHwBcoeCwcnKyG19QcB1F-c6OtdEflktR0nFiPSS3MR4pg1xfmquZU3zs1zPYUQBvoUWJKDNuWUMrYjfEfuLgXSznFooL-Vozk7XYxj10jZtPYwWI0dYlVgPRH9uL7qnAyDeZAfsWN3zMhFUxw-8M4vOKDTA7pjWXt2D2Nc Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: cbd79cd5dd034dec885a0a56cd16b993 Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-TestMinimumBasicScenario-1678975982 Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:17:05.015406 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cbd79cd5dd034dec885a0a56cd16b993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cbd79cd5dd034dec885a0a56cd16b993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cbd79cd5dd034dec885a0a56cd16b993"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cbd79cd5dd034dec885a0a56cd16b993", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-TestMinimumBasicScenario-1678975982 Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: cbd79cd5dd034dec885a0a56cd16b993 Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1678975982 Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-TestMinimumBasicScenario-1678975982-project Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: c7d0b7e3000444c1969640bfd27d72ba Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-TestMinimumBasicScenario-1678975982-project Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:17:05.016962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c is not attached to volume ea921415-ec94-46fe-bef1-13ca67c5383d Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'server_id': 'cf9e672c-ee0d-4780-b6b7-f064cf29549c', 'id': 'ea921415-ec94-46fe-bef1-13ca67c5383d'} Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea921415-ec94-46fe-bef1-13ca67c5383d. Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:17:05.017768 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c is not attached to volume ea921415-ec94-46fe-bef1-13ca67c5383d Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c is not attached to volume ea921415-ec94-46fe-bef1-13ca67c5383d Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:05.019158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Returning 404 to user: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c is not attached to volume ea921415-ec94-46fe-bef1-13ca67c5383d {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:17:05.020265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6fa4e3e1-8503-4747-b42d-3cd6f8e96db3 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments/ea921415-ec94-46fe-bef1-13ca67c5383d" status: 404 len: 154 microversion: 2.1 time: 0.095807 Jun 29 16:17:05.020265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 444/870] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:17:04 2022] DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c/os-volume_attachments/ea921415-ec94-46fe-bef1-13ca67c5383d => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:05.296757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-722e7662-fdc1-4551-b53a-633003ccd1c2 req-ca42340b-504d-4d98-ad13-8d47fe32f811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:05.305261 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-722e7662-fdc1-4551-b53a-633003ccd1c2 req-ca42340b-504d-4d98-ad13-8d47fe32f811 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:05.305702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-722e7662-fdc1-4551-b53a-633003ccd1c2 req-ca42340b-504d-4d98-ad13-8d47fe32f811 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:05.317279 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-722e7662-fdc1-4551-b53a-633003ccd1c2 req-ca42340b-504d-4d98-ad13-8d47fe32f811 service nova] Creating event network-changed:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:17:05.322070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-722e7662-fdc1-4551-b53a-633003ccd1c2 req-ca42340b-504d-4d98-ad13-8d47fe32f811 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029514 Jun 29 16:17:05.322631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 427/871] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:05.915464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:05.916105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:05.923636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:05.924366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:05.926199 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:05.926733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:05.953767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:17:06.030928 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7ee7edc1-7a47-46bd-aa13-3959c6160415 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 204 len: 0 microversion: 2.1 time: 0.119032 Jun 29 16:17:06.031762 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 445/872] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:17:05 2022] DELETE /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:17:06.040943 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:06.041643 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:06.048755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:06.049202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:06.049962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:06.050397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:06.184823 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:06.193742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a0cc2a7-18fa-4e2d-991f-4df7a2d2fe87 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1507 microversion: 2.1 time: 0.157721 Jun 29 16:17:06.194305 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 428/873] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:06 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:06.306745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:06.307362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:06.313894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:06.314341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:06.315099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:06.315538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:06.341853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:17:06.414968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2f58639e-8a37-42c6-b179-34c47ba98190 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 204 len: 0 microversion: 2.1 time: 0.112205 Jun 29 16:17:06.415546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 446/874] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:17:06 2022] DELETE /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:17:06.423735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:06.424397 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:06.430312 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:06.430746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:06.431495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:06.431960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:06.567600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:06.575697 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a9965b3-8d05-4c44-99ed-5f96be1c0a29 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1554 microversion: 2.1 time: 0.155757 Jun 29 16:17:06.576293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 429/875] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:06 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:07.211306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:07.212204 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:07.218701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:07.219149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:07.219928 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:07.220362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:07.350782 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:07.359011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f25cc539-215b-436b-b1a4-6139fa179bb5 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1507 microversion: 2.1 time: 0.151875 Jun 29 16:17:07.359657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 447/876] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:07 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:07.593427 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:07.593950 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:07.600454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:07.600922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:07.601685 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:07.602114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:07.730488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:07.738866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c02d4ecf-da6d-4116-a869-d5c37d98487c tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1554 microversion: 2.1 time: 0.149705 Jun 29 16:17:07.739422 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 430/877] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:07 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:08.376172 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:08.376799 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:08.383656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:08.384127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:08.384880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:08.385306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:08.516990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:08.524578 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ac34e36b-60ef-44cb-aa3e-03c319d4d20e tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1507 microversion: 2.1 time: 0.152352 Jun 29 16:17:08.525141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 448/878] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:08 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:08.757826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:08.758535 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:08.765626 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:08.766067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:08.766816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:08.767239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:08.898698 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:08.906166 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cb5fb719-0701-4a27-ac13-50b8c6b9636a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1554 microversion: 2.1 time: 0.152512 Jun 29 16:17:08.906725 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 431/879] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:08 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:09.541185 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:09.541853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:09.549241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:09.549716 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:09.550545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:09.551083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:09.618588 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:09.631330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b0e429e4-5c0e-4e83-9a29-8ceae2a36651 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 200 len: 1465 microversion: 2.1 time: 0.093943 Jun 29 16:17:09.632943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 449/880] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:09 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 1465 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:09.696886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-547ffd2b-7c68-4ee8-b4c8-ae402a80bc87 req-86653ff2-bc47-497b-b341-9289f85b32a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f66543e-7e81-4899-afc9-ce96bb61bcaa", "name": "network-vif-deleted", "tag": "348e22b7-2fb7-43b6-8faa-ccc5e3b72cd9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:09.707510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-547ffd2b-7c68-4ee8-b4c8-ae402a80bc87 req-86653ff2-bc47-497b-b341-9289f85b32a5 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:09.708064 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-547ffd2b-7c68-4ee8-b4c8-ae402a80bc87 req-86653ff2-bc47-497b-b341-9289f85b32a5 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:09.721211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-547ffd2b-7c68-4ee8-b4c8-ae402a80bc87 req-86653ff2-bc47-497b-b341-9289f85b32a5 service nova] Creating event network-vif-deleted:348e22b7-2fb7-43b6-8faa-ccc5e3b72cd9 for instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa on hv-cinder-84814 Jun 29 16:17:09.727420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-547ffd2b-7c68-4ee8-b4c8-ae402a80bc87 req-86653ff2-bc47-497b-b341-9289f85b32a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 Jun 29 16:17:09.729029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 432/881] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:09.922629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:09.923137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:09.929224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:09.929654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:09.930411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:09.930845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:09.962225 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:09.962671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:09.963116 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lazy-loading 'fault' on Instance uuid cf9e672c-ee0d-4780-b6b7-f064cf29549c {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:17:10.007696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d0b7e3000444c1969640bfd27d72ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd79cd5dd034dec885a0a56cd16b993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:10.015958 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8485c2dd-8c5d-49e8-8007-85c85be6bb9a tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 200 len: 1348 microversion: 2.1 time: 0.097306 Jun 29 16:17:10.016543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 450/882] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:09 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:10.650664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:10.651466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: 5f66543e-7e81-4899-afc9-ce96bb61bcaa] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:10.658396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:10.658835 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:10.659601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:10.660075 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:10.675417 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] HTTP exception thrown: Instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa could not be found. Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Request method failure captured: Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa HTTP/1.1 Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlXw1Xys1yLNlsVxFpzGFllqOJH4MLqZcWiNaXyWAAyEU8Dgm4FVBsRAlPVamkBLTLYGZSjigNnLlFpOZ-Qrb_KvL-sLmWKrZQLxM3Nqmbey4d0JTFfSmVGFeyQhlKDvOy4Dr54Pv8vxKPRw-pmt5UxyLLEmpM21MEZO_yM8QgB4QM Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:17:10.677218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a410f5a9cef44b39a657b28f6c1772b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 1c00db02926f4d849249c3990fdf8308 Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa could not be found. Jun 29 16:17:10.678608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '5f66543e-7e81-4899-afc9-ce96bb61bcaa'} Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa could not be found. Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:17:10.679383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa could not be found. Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa could not be found. Jun 29 16:17:10.680611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:17:10.681656 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Returning 404 to user: Instance 5f66543e-7e81-4899-afc9-ce96bb61bcaa could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:17:10.681656 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0a9b95a-218f-4f74-8e32-d0c55e229e31 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa" status: 404 len: 111 microversion: 2.1 time: 0.033099 Jun 29 16:17:10.681656 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 433/883] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:10 2022] GET /compute/v2.1/servers/5f66543e-7e81-4899-afc9-ce96bb61bcaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:10.690897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:10.691417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:10.697982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:10.698418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:10.699179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:10.699616 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:10.727280 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:17:10.778671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:10.803735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d8411292-8a47-4e0a-b120-17a7bf4b64d4 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 204 len: 0 microversion: 2.1 time: 0.116390 Jun 29 16:17:10.804368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 451/884] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:17:10 2022] DELETE /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:17:10.813336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:10.813875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:10.819843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:10.820299 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:10.821050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:10.821485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:10.954201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:10.961700 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-180d87c5-5a35-4578-8f9f-7f1d884ad0a2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.152926 Jun 29 16:17:10.962245 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 434/885] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:10 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:11.033500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:11.034210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] [instance: cf9e672c-ee0d-4780-b6b7-f064cf29549c] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:11.040333 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:11.040832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:11.041602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:11.042036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:11.055568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] HTTP exception thrown: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c could not be found. Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Request method failure captured: Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c HTTP/1.1 Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHoHDoW2OHwBcoeCwcnKyG19QcB1F-c6OtdEflktR0nFiPSS3MR4pg1xfmquZU3zs1zPYUQBvoUWJKDNuWUMrYjfEfuLgXSznFooL-Vozk7XYxj10jZtPYwWI0dYlVgPRH9uL7qnAyDeZAfsWN3zMhFUxw-8M4vOKDTA7pjWXt2D2Nc Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: cbd79cd5dd034dec885a0a56cd16b993 Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-TestMinimumBasicScenario-1678975982 Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:17:11.057270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cbd79cd5dd034dec885a0a56cd16b993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cbd79cd5dd034dec885a0a56cd16b993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cbd79cd5dd034dec885a0a56cd16b993"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cbd79cd5dd034dec885a0a56cd16b993", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-TestMinimumBasicScenario-1678975982 Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: cbd79cd5dd034dec885a0a56cd16b993 Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1678975982 Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-TestMinimumBasicScenario-1678975982-project Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: c7d0b7e3000444c1969640bfd27d72ba Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-TestMinimumBasicScenario-1678975982-project Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c could not be found. Jun 29 16:17:11.058863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': 'cf9e672c-ee0d-4780-b6b7-f064cf29549c'} Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c could not be found. Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:17:11.060281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c could not be found. Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c could not be found. Jun 29 16:17:11.061709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:11.062951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Returning 404 to user: Instance cf9e672c-ee0d-4780-b6b7-f064cf29549c could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:17:11.062951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-eb97bb9f-19c0-412a-bb9b-d020e63dae93 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c" status: 404 len: 111 microversion: 2.1 time: 0.029379 Jun 29 16:17:11.062951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 452/886] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:11 2022] GET /compute/v2.1/servers/cf9e672c-ee0d-4780-b6b7-f064cf29549c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:11.068048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5501a058-e012-45fd-b33b-5caa4244bb27 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] Calling method '.version_select at 0x7f0434cbed30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:11.087728 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5501a058-e012-45fd-b33b-5caa4244bb27 tempest-TestMinimumBasicScenario-1678975982 tempest-TestMinimumBasicScenario-1678975982-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-308779180" status: 202 len: 0 microversion: 2.1 time: 0.023524 Jun 29 16:17:11.088326 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 435/887] 10.222.0.47 () {58 vars in 1268 bytes} [Wed Jun 29 16:17:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-308779180 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:17:11.743223 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-973ee9f7-2a23-4e59-b922-33e0c90b5427 req-fbe2fcbd-95cd-4ed6-a3a8-42306d860f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9e672c-ee0d-4780-b6b7-f064cf29549c", "name": "network-vif-deleted", "tag": "088f3460-37f2-4382-b202-500be881304d"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:11.751681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-973ee9f7-2a23-4e59-b922-33e0c90b5427 req-fbe2fcbd-95cd-4ed6-a3a8-42306d860f49 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:11.752153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-973ee9f7-2a23-4e59-b922-33e0c90b5427 req-fbe2fcbd-95cd-4ed6-a3a8-42306d860f49 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:11.763184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-973ee9f7-2a23-4e59-b922-33e0c90b5427 req-fbe2fcbd-95cd-4ed6-a3a8-42306d860f49 service nova] Creating event network-vif-deleted:088f3460-37f2-4382-b202-500be881304d for instance cf9e672c-ee0d-4780-b6b7-f064cf29549c on hv-cinder-84814 Jun 29 16:17:11.768275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-973ee9f7-2a23-4e59-b922-33e0c90b5427 req-fbe2fcbd-95cd-4ed6-a3a8-42306d860f49 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028753 Jun 29 16:17:11.768857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 453/888] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:17:11.979046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:11.979633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:11.986002 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:11.986358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:11.987128 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:11.987550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:12.416495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:12.424083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a7965ddc-26f4-467e-b5b0-15f79f1e1a03 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.449288 Jun 29 16:17:12.424635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 436/889] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:11 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:13.443011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:13.443712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:13.450429 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:13.450879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:13.451635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:13.452091 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:13.599849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:13.609363 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2001ef6d-4954-4390-97d2-0e3c2afcb0e1 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1522 microversion: 2.1 time: 0.171291 Jun 29 16:17:13.610017 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 454/890] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:13 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:14.626819 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:14.627431 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:14.634893 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:14.635334 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:14.636154 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:14.636586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:14.797763 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-1a2dfa55-7629-4d73-93cf-946a7107d28a req-a37c88a1-e756-4f94-b9d2-66d4617381b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf0d9bb-22cd-43e2-a70c-ea778282a1d7", "name": "network-vif-deleted", "tag": "fb153181-1b50-4fe4-af4b-8c992e6820af"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:14.806573 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-1a2dfa55-7629-4d73-93cf-946a7107d28a req-a37c88a1-e756-4f94-b9d2-66d4617381b6 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:14.807101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-1a2dfa55-7629-4d73-93cf-946a7107d28a req-a37c88a1-e756-4f94-b9d2-66d4617381b6 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:14.819136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c00db02926f4d849249c3990fdf8308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a410f5a9cef44b39a657b28f6c1772b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:14.820380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-1a2dfa55-7629-4d73-93cf-946a7107d28a req-a37c88a1-e756-4f94-b9d2-66d4617381b6 service nova] Creating event network-vif-deleted:fb153181-1b50-4fe4-af4b-8c992e6820af for instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 on hv-cinder-84814 Jun 29 16:17:14.826383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-1a2dfa55-7629-4d73-93cf-946a7107d28a req-a37c88a1-e756-4f94-b9d2-66d4617381b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Jun 29 16:17:14.827330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 455/891] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:14.839067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a36fc918-37d2-48a5-9a7c-5f446b23c6f2 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 200 len: 1480 microversion: 2.1 time: 0.216607 Jun 29 16:17:14.839633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 437/892] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:14 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 1480 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:15.856936 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:15.857546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] [instance: dcf0d9bb-22cd-43e2-a70c-ea778282a1d7] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:15.863908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:15.864941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:15.865700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:15.866138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:15.879556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] HTTP exception thrown: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 could not be found. Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Request method failure captured: Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 HTTP/1.1 Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlXw1Xys1yLNlsVxFpzGFllqOJH4MLqZcWiNaXyWAAyEU8Dgm4FVBsRAlPVamkBLTLYGZSjigNnLlFpOZ-Qrb_KvL-sLmWKrZQLxM3Nqmbey4d0JTFfSmVGFeyQhlKDvOy4Dr54Pv8vxKPRw-pmt5UxyLLEmpM21MEZO_yM8QgB4QM Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:17:15.881252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a410f5a9cef44b39a657b28f6c1772b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a410f5a9cef44b39a657b28f6c1772b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 6a410f5a9cef44b39a657b28f6c1772b Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131662024 Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 1c00db02926f4d849249c3990fdf8308 Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131662024-project Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 could not be found. Jun 29 16:17:15.883051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': 'dcf0d9bb-22cd-43e2-a70c-ea778282a1d7'} Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 could not be found. Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:17:15.883940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 could not be found. Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 could not be found. Jun 29 16:17:15.889351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:15.890840 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] Returning 404 to user: Instance dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:17:15.890840 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-01c3405e-a8ff-4d04-9508-a5ec6357ff08 tempest-ServerRescueNegativeTestJSON-131662024 tempest-ServerRescueNegativeTestJSON-131662024-project] 10.222.0.47 "GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7" status: 404 len: 111 microversion: 2.1 time: 0.032438 Jun 29 16:17:15.890840 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 456/893] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:15 2022] GET /compute/v2.1/servers/dcf0d9bb-22cd-43e2-a70c-ea778282a1d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:30.443911 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:30.444953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:30.447994 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:30.448788 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:30.457427 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:30.458037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:30.458964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:30.459574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:30.492140 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-28e95918-b59e-42e8-b923-47eaf647a392 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052969 Jun 29 16:17:30.493308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 438/894] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:17:30 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:17:30.563141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:30.564008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:30.571531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:30.572236 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=14 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:30.573744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:30.574190 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:30.574967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:30.576021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:30.612067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:17:30.713757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1094f6da-103e-491e-be1e-ab82202592d3 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 204 len: 0 microversion: 2.1 time: 0.155694 Jun 29 16:17:30.714682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 457/895] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:17:30 2022] DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:17:30.724928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:30.725641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:30.733607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:30.735858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:30.737028 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:30.737840 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:30.977369 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:30.984937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e94bf935-ddee-4d0c-8096-b8eda5df2831 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1675 microversion: 2.1 time: 0.265394 Jun 29 16:17:30.985498 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 439/896] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:30 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:17:31.379058 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d5c5b1b6-9dc0-4ad7-862f-1a84d6e3d145 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Action: 'create', calling method: .version_select at 0x7f0434ced280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1528332792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmAB+vNDKzt/9zgz4D0bj6KgspSM++TFQzZas7U3dqIUKgtjMfaetg+ba+3Ok/y3SWJaOYygQx2PYG9zNyBiMD9NbXiVj9TKn4YHjkgXB6+Xctmz8oiSwscBw1RwR8UiA=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:31.394944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-d5c5b1b6-9dc0-4ad7-862f-1a84d6e3d145 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:17:31.399115 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-d5c5b1b6-9dc0-4ad7-862f-1a84d6e3d145 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for user da01cd253f6e4bc792868f337ff85b0a and project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:17:31.427394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d5c5b1b6-9dc0-4ad7-862f-1a84d6e3d145 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.287832 Jun 29 16:17:31.429003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 458/897] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:17:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:17:32.003748 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:32.009118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:32.015816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:32.016388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:32.017345 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:32.017778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:32.313917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:32.322371 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43b7c3ce-e486-4472-92fd-cee7acb3f324 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1675 microversion: 2.1 time: 0.323261 Jun 29 16:17:32.329002 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 440/898] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:31 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1675 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:33.328498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-edb0570d-b612-4083-af03-57a7647e9c6d req-739f850f-1b82-450b-b39a-325ceb9a68d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c82fec7-271e-4a90-82ae-0425c0c53431", "name": "network-vif-deleted", "tag": "7303208a-252a-4cdb-a5b7-e4a759514ef5"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:33.356398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:33.360432 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:33.384611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:33.393264 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:33.400787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-edb0570d-b612-4083-af03-57a7647e9c6d req-739f850f-1b82-450b-b39a-325ceb9a68d8 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:33.401617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:33.402380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-edb0570d-b612-4083-af03-57a7647e9c6d req-739f850f-1b82-450b-b39a-325ceb9a68d8 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:33.403045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:33.446521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-edb0570d-b612-4083-af03-57a7647e9c6d req-739f850f-1b82-450b-b39a-325ceb9a68d8 service nova] Creating event network-vif-deleted:7303208a-252a-4cdb-a5b7-e4a759514ef5 for instance 6c82fec7-271e-4a90-82ae-0425c0c53431 on hv-cinder-84814 Jun 29 16:17:33.462909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-edb0570d-b612-4083-af03-57a7647e9c6d req-739f850f-1b82-450b-b39a-325ceb9a68d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142577 Jun 29 16:17:33.463520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 459/899] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:17:33.553680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:33.562439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13209b35-da44-4590-9582-63933f0316b5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 200 len: 1323 microversion: 2.1 time: 0.223519 Jun 29 16:17:33.563252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 441/900] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:33 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 1323 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:34.587181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:34.588716 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:34.597386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:34.599535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:34.600603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:34.603584 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:34.628605 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] HTTP exception thrown: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Request method failure captured: Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 HTTP/1.1 Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlaphCGE5jeIouuboiqB6H0-4iIy5-jFqOlEOXSPnk5wECeOipVd19rtnNBpwJdUNfd-2sre5uRCCMbHuu60paD9rhQi0MCOrZR_gDP06Xck2noLbG5sdccnWnRn1dPfuFmvyvAKqINKPA2NjH4SzmCcyaa4WAPpxG6Ye-NwrXe2bQ Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:17:34.631233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3fa6a9273bf24c67bfc20849da531320", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 5b45e8b15637406eb145ca6e756e1f44 Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:17:34.632655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '6c82fec7-271e-4a90-82ae-0425c0c53431'} Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:17:34.633707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:17:34.634939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:17:34.638340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Returning 404 to user: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:17:34.639709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0df2ddd5-b06a-43d8-9230-90df74001b60 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 404 len: 111 microversion: 2.1 time: 0.061940 Jun 29 16:17:34.640584 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 460/901] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:34 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:34.655111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-864d1131-b041-4bef-b69e-105c1589d235 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '.version_select at 0x7f04395bb3a0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:34.686496 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-864d1131-b041-4bef-b69e-105c1589d235 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964214611" status: 202 len: 0 microversion: 2.1 time: 0.039121 Jun 29 16:17:34.687714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 442/902] 10.222.0.47 () {58 vars in 1220 bytes} [Wed Jun 29 16:17:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964214611 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:17:35.729296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b8961819-3917-44a5-bc0a-0a4e582e148d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: .version_select at 0x7f0434cfa1f0>, body: {"keypair": {"name": "tempest-keypair-851900576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkvMqelKpW/+StVBHRDw12RPmX9Zbb9uOCD0Pyn++hIG9ll1dB7VrOpDcg1Ym+8s91ihSyD7OB4vK7Obo2XsUod/iVxlgVowo2Jpyscm1O2nP5/n01OzgTvmEmN6eLtuw=="}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:35.754086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-b8961819-3917-44a5-bc0a-0a4e582e148d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for project 3fa6a9273bf24c67bfc20849da531320. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:17:35.759202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-b8961819-3917-44a5-bc0a-0a4e582e148d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for user 5b45e8b15637406eb145ca6e756e1f44 and project 3fa6a9273bf24c67bfc20849da531320. Resources: {'key_pairs'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:17:35.789479 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b8961819-3917-44a5-bc0a-0a4e582e148d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064074 Jun 29 16:17:35.790601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 461/903] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:17:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:37.332152 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1012425940", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8b4a59a-8d13-4d0c-b500-ca8a3cc543b2"}], "security_groups": [{"name": "tempest-securitygroup--2012064165"}], "key_name": "tempest-keypair-851900576", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:37.447984 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] validate_networks() for [('a8b4a59a-8d13-4d0c-b500-ca8a3cc543b2', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:17:37.934225 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:17:37.935546 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:17:37.936920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:17:37.937466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:17:37.937888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:17:37.946812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:37.947258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:37.948080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:37.948515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:37.965221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for project 3fa6a9273bf24c67bfc20849da531320. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:17:37.969791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Getting quotas for user 5b45e8b15637406eb145ca6e756e1f44 and project 3fa6a9273bf24c67bfc20849da531320. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:17:37.980662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:17:37.983576 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:17:38.030968 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74b05627-1de7-46a1-8f0f-52759fad5646 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.703315 Jun 29 16:17:38.036796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 443/904] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:17:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:17:38.042517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aeabdd25-6636-4a45-ab6d-0d52b4371878 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:38.043229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-aeabdd25-6636-4a45-ab6d-0d52b4371878 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:38.117691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-aeabdd25-6636-4a45-ab6d-0d52b4371878 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:38.124922 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-aeabdd25-6636-4a45-ab6d-0d52b4371878 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1237 microversion: 2.1 time: 0.086755 Jun 29 16:17:38.125740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 462/905] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:38 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:39.142981 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:39.143589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:39.149802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:39.150488 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:39.151250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:39.151680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:39.242296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:39.250755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-336a999c-7f64-4362-acf0-46c5ad173177 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1307 microversion: 2.1 time: 0.112057 Jun 29 16:17:39.251325 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 444/906] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:39 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:40.268269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:40.269470 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:40.276133 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:40.276589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:40.277350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:40.277787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:40.408839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:40.416303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bd789583-cb1d-40cf-b297-a824b1cebe16 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.152020 Jun 29 16:17:40.416869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 463/907] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:40 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:40.893795 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-4c23cb93-a451-4458-a086-872507f75592 req-7ae4c678-6b7e-4d37-b959-c8d791927e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663fa951-d347-4f0e-941f-5040e715a534", "tag": "0adfcfe5-9630-4815-8d20-4641f9ad5f94"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:40.907351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4c23cb93-a451-4458-a086-872507f75592 req-7ae4c678-6b7e-4d37-b959-c8d791927e83 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:40.907808 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4c23cb93-a451-4458-a086-872507f75592 req-7ae4c678-6b7e-4d37-b959-c8d791927e83 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:40.940151 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-4c23cb93-a451-4458-a086-872507f75592 req-7ae4c678-6b7e-4d37-b959-c8d791927e83 service nova] Creating event network-changed:0adfcfe5-9630-4815-8d20-4641f9ad5f94 for instance 663fa951-d347-4f0e-941f-5040e715a534 on hv-cinder-84814 Jun 29 16:17:40.947435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-4c23cb93-a451-4458-a086-872507f75592 req-7ae4c678-6b7e-4d37-b959-c8d791927e83 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057028 Jun 29 16:17:40.948222 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 445/908] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:41.433761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:41.434369 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:41.441327 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:41.441775 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:41.442531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:41.443027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:41.588489 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:41.597269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-19f9e086-7745-4fe3-876d-173ea308da11 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.167141 Jun 29 16:17:41.598073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 464/909] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:41 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:42.615978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:42.616910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:42.626758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:42.627219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:42.628203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:42.628760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:42.766863 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:42.774317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-59bcfe41-5f20-4727-93c3-762ca2e3508c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.163469 Jun 29 16:17:42.774879 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 446/910] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:42 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:43.790838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:43.792053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:43.800455 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:43.801114 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:43.801879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:43.802313 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:43.959560 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:43.968343 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a0a0d286-0ad5-46b0-b828-ca0aaa2d78ef tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.181316 Jun 29 16:17:43.968905 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 465/911] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:43 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:44.990463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:44.998269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:45.006110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:45.006644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:45.007680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:45.008224 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:45.160101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:45.170579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a6fbc3dc-18a6-4898-98c8-3ec0877c29cd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.188812 Jun 29 16:17:45.179216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 447/912] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:44 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:45.867274 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-6bdac550-8b1c-4ab9-a5dc-f8770eb96f4e req-90799c1c-f58d-4332-a2c0-57982855e74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663fa951-d347-4f0e-941f-5040e715a534", "name": "network-vif-plugged", "status": "completed", "tag": "0adfcfe5-9630-4815-8d20-4641f9ad5f94"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:45.875949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-6bdac550-8b1c-4ab9-a5dc-f8770eb96f4e req-90799c1c-f58d-4332-a2c0-57982855e74c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:45.876596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-6bdac550-8b1c-4ab9-a5dc-f8770eb96f4e req-90799c1c-f58d-4332-a2c0-57982855e74c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:45.888685 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-6bdac550-8b1c-4ab9-a5dc-f8770eb96f4e req-90799c1c-f58d-4332-a2c0-57982855e74c service nova] Creating event network-vif-plugged:0adfcfe5-9630-4815-8d20-4641f9ad5f94 for instance 663fa951-d347-4f0e-941f-5040e715a534 on hv-cinder-84814 Jun 29 16:17:45.893675 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-6bdac550-8b1c-4ab9-a5dc-f8770eb96f4e req-90799c1c-f58d-4332-a2c0-57982855e74c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 Jun 29 16:17:45.894544 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 466/913] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:46.188572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:46.189288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:46.196092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:46.196741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:46.197771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:46.198319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:46.382409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:46.390063 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0fa5a40-e1fa-4a71-9165-e0eb0b1acc12 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.205861 Jun 29 16:17:46.390629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 448/914] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:46 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:47.408384 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:47.409081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:47.415257 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:47.415953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:47.416726 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:47.417162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:47.556123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:47.564846 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2c475106-f872-47eb-91c4-a587d92afb48 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1363 microversion: 2.1 time: 0.161854 Jun 29 16:17:47.565771 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 467/915] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:47 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:48.581594 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:48.582203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:48.584621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:48.585331 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:48.591715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:48.592220 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:48.592933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:48.593366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:48.730478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:17:48.739028 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b059bde9-48bf-481c-bdc6-daa40ebbb81d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1548 microversion: 2.1 time: 0.161256 Jun 29 16:17:48.739592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 449/916] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:17:48 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:17:48.755262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:17:48.755758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:17:48.757781 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=10 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:48.764538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:48.765011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:48.765762 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:48.766188 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:48.842083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4c8a1d24-a372-482b-8c08-cc468e2221e1 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090006 Jun 29 16:17:48.842699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 468/917] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:17:48 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:17:49.981883 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ba9368d0-e683-47c5-974e-aa84d6cb8666 req-06791ccb-2dd4-4975-8943-5b69f6d755ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663fa951-d347-4f0e-941f-5040e715a534", "tag": "0adfcfe5-9630-4815-8d20-4641f9ad5f94"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:17:49.991179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ba9368d0-e683-47c5-974e-aa84d6cb8666 req-06791ccb-2dd4-4975-8943-5b69f6d755ff service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:17:49.991616 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ba9368d0-e683-47c5-974e-aa84d6cb8666 req-06791ccb-2dd4-4975-8943-5b69f6d755ff service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:17:50.002394 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ba9368d0-e683-47c5-974e-aa84d6cb8666 req-06791ccb-2dd4-4975-8943-5b69f6d755ff service nova] Creating event network-changed:0adfcfe5-9630-4815-8d20-4641f9ad5f94 for instance 663fa951-d347-4f0e-941f-5040e715a534 on hv-cinder-84814 Jun 29 16:17:50.007799 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ba9368d0-e683-47c5-974e-aa84d6cb8666 req-06791ccb-2dd4-4975-8943-5b69f6d755ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032801 Jun 29 16:17:50.008426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 450/918] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:00.048797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:00.049609 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:00.053553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2026064591", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1528332792", "security_groups": [{"name": "tempest-secgroup-smoke-1095340995"}], "block_device_mapping_v2": [{"uuid": "5e33aeda-2b91-4f4a-b091-95f462be6953", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1a48c25-8bb7-4e07-98a2-dce74f3bae14"}]}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:00.168310 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] validate_networks() for [('b1a48c25-8bb7-4e07-98a2-dce74f3bae14', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:18:00.522518 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:18:00.522941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:18:00.523409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:18:00.523814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:18:00.524241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:18:00.534409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:00.534851 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:00.535664 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:00.536127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:00.553101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:18:00.556990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for user da01cd253f6e4bc792868f337ff85b0a and project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:18:00.612905 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:18:00.614954 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e33aeda-2b91-4f4a-b091-95f462be6953',volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:18:00.742556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-43ad94db-34f1-499e-bf7b-fa71cd42a068 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695054 Jun 29 16:18:00.743184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 469/919] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:18:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:18:00.753584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9c5fec63-95e2-4cbc-9023-76b528ba6ef3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:00.754292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9c5fec63-95e2-4cbc-9023-76b528ba6ef3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:00.756911 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:00.757811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=60 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:00.814291 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9c5fec63-95e2-4cbc-9023-76b528ba6ef3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:00.820985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9c5fec63-95e2-4cbc-9023-76b528ba6ef3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1095 microversion: 2.1 time: 0.071579 Jun 29 16:18:00.821548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 451/920] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:00 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:18:01.838162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:01.838802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:01.845942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:01.846380 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:01.847125 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:01.847554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:01.909737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:01.916992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d822702e-1f2f-4368-9d11-7c8be35acbd7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1193 microversion: 2.1 time: 0.083185 Jun 29 16:18:01.917545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 470/921] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:01 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:02.935211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:02.935851 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:02.944848 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:02.945500 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:02.947047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:02.947648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:03.212448 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:03.220464 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d9c03d28-418d-4fbd-b33d-8c914e503167 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1279 microversion: 2.1 time: 0.289782 Jun 29 16:18:03.221300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 452/922] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:02 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1279 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:03.566900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-ef197a3f-3ddf-4e42-8505-4019ebda769a req-cfd1a7dc-8cae-47a3-854b-ed6d84bf2857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd", "tag": "3d9e16e1-9be2-44af-9608-e0db3a027bcf"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:03.577766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-ef197a3f-3ddf-4e42-8505-4019ebda769a req-cfd1a7dc-8cae-47a3-854b-ed6d84bf2857 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:03.578301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-ef197a3f-3ddf-4e42-8505-4019ebda769a req-cfd1a7dc-8cae-47a3-854b-ed6d84bf2857 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:03.594086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-ef197a3f-3ddf-4e42-8505-4019ebda769a req-cfd1a7dc-8cae-47a3-854b-ed6d84bf2857 service nova] Creating event network-changed:3d9e16e1-9be2-44af-9608-e0db3a027bcf for instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd on hv-cinder-84814 Jun 29 16:18:03.614419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-ef197a3f-3ddf-4e42-8505-4019ebda769a req-cfd1a7dc-8cae-47a3-854b-ed6d84bf2857 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052773 Jun 29 16:18:03.615195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 471/923] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:18:04.238151 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:04.238760 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:04.245239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:04.245682 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:04.246431 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:04.246863 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:04.375595 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:04.383174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d0ebc21b-75c5-4d45-bab4-2fa713323712 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.148874 Jun 29 16:18:04.383729 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 453/924] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:04 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:05.401718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:05.402315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:05.409181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:05.409625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:05.410373 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:05.410798 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:05.547137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:05.555001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-769f315f-0e99-4319-bd35-f3cba98e1671 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.157565 Jun 29 16:18:05.555566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 472/925] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:05 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:06.571719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:06.572359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:06.578870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:06.579321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:06.580111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:06.580552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:06.708830 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:06.716294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa30c470-c885-48a9-8d17-856777f8f2d7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.149049 Jun 29 16:18:06.716849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 454/926] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:06 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:07.734416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:07.735014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:07.741429 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:07.741871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:07.742615 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:07.743044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:07.874105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:07.881682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0a445283-ebaa-49a2-b0fc-4173fa2fd8e9 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.151912 Jun 29 16:18:07.882243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 473/927] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:07 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:08.898357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:08.898962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:08.905327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:08.905764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:08.906505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:08.906931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:09.036449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:09.043960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-50fcf02b-f4e5-4b80-a731-6caa192f9ae6 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.149390 Jun 29 16:18:09.044518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 455/928] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:08 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:10.060829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:10.061942 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:10.068545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:10.068987 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:10.069727 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:10.070154 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:10.201832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:10.209805 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-33f7a328-4529-411c-b7e8-b3f63a3c48ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.152857 Jun 29 16:18:10.210403 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 474/929] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:10 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:11.226467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:11.227072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:11.229446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:11.234584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:11.235030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:11.235779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:11.236239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:11.363046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:11.370398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f5946edf-89a8-4678-be99-15218b425498 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.147764 Jun 29 16:18:11.370963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 456/930] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:11 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:12.387484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:12.388085 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:12.390583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:12.391419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:12.397626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:12.398075 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:12.398836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:12.399271 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:12.528425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:12.535792 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e0da0267-8606-48ad-a6a6-54fad64ca69e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.152561 Jun 29 16:18:12.536383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 475/931] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:12 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:13.552921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:13.553536 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:13.560580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:13.561025 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:13.561888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:13.562387 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:13.694094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:13.701477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6185b781-dc87-4624-a9f6-d4b4a59b5f56 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.152890 Jun 29 16:18:13.702036 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 457/932] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:13 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:14.719112 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:14.719691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:14.726218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:14.726661 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:14.727414 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:14.727862 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:14.857220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:14.867083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-745c90eb-aa1f-4661-91e0-55c5b00f4b97 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.152033 Jun 29 16:18:14.867936 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 476/933] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:14 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:15.883680 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:15.884603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:15.891984 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:15.892426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:15.893177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:15.893604 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:16.050893 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:16.061105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2fa2ac72-a57c-4e38-b58a-ec2d9c282c39 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.181075 Jun 29 16:18:16.070580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 458/934] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:15 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:16.095911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-0c53bf24-7c7a-4825-8b61-8bcb4c25f4a3 req-87323c94-6959-4b3d-8b87-c63b1f3193b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd", "name": "network-vif-plugged", "status": "completed", "tag": "3d9e16e1-9be2-44af-9608-e0db3a027bcf"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:16.106073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-0c53bf24-7c7a-4825-8b61-8bcb4c25f4a3 req-87323c94-6959-4b3d-8b87-c63b1f3193b4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:16.106519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-0c53bf24-7c7a-4825-8b61-8bcb4c25f4a3 req-87323c94-6959-4b3d-8b87-c63b1f3193b4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:16.121476 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-0c53bf24-7c7a-4825-8b61-8bcb4c25f4a3 req-87323c94-6959-4b3d-8b87-c63b1f3193b4 service nova] Creating event network-vif-plugged:3d9e16e1-9be2-44af-9608-e0db3a027bcf for instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd on hv-cinder-84814 Jun 29 16:18:16.126707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-0c53bf24-7c7a-4825-8b61-8bcb4c25f4a3 req-87323c94-6959-4b3d-8b87-c63b1f3193b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035248 Jun 29 16:18:16.127315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 477/935] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:17.079908 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:17.081199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:17.087526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:17.087999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:17.088758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:17.089363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:17.217602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:17.224891 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-55b8b2ea-387a-4dcc-86da-f066da5316ec tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.148779 Jun 29 16:18:17.225443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 459/936] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:17 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:18.243039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:18.243737 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:18.250473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:18.250917 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:18.251674 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:18.252138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:18.386481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:18.394501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b8086085-ed62-4c6e-aac2-dc7e58c71e53 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1267 microversion: 2.1 time: 0.156210 Jun 29 16:18:18.395058 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 478/937] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:18 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:19.410980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:19.411621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:19.418118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:19.418567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:19.419329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:19.419761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:19.703648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:19.711122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-694b3624-c6b7-40cd-a2ce-7516c4dd6cf2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1453 microversion: 2.1 time: 0.303987 Jun 29 16:18:19.711666 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 460/938] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:19 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1453 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:19.726953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:19.727560 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:19.734072 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:19.734518 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:19.735267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:19.735704 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:19.862766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:19.870331 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ad36c7b4-c100-42cd-82f5-3512715c8a1d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1453 microversion: 2.1 time: 0.147193 Jun 29 16:18:19.870892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 479/939] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:19 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:21.561964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-19aac0a2-9d7e-4961-aeb8-14a0305b4c16 req-db198291-2745-4cde-a1a3-58a4bec54df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd", "tag": "3d9e16e1-9be2-44af-9608-e0db3a027bcf"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:21.570641 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-19aac0a2-9d7e-4961-aeb8-14a0305b4c16 req-db198291-2745-4cde-a1a3-58a4bec54df8 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:21.571078 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-19aac0a2-9d7e-4961-aeb8-14a0305b4c16 req-db198291-2745-4cde-a1a3-58a4bec54df8 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:21.582319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-19aac0a2-9d7e-4961-aeb8-14a0305b4c16 req-db198291-2745-4cde-a1a3-58a4bec54df8 service nova] Creating event network-changed:3d9e16e1-9be2-44af-9608-e0db3a027bcf for instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd on hv-cinder-84814 Jun 29 16:18:21.587343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-19aac0a2-9d7e-4961-aeb8-14a0305b4c16 req-db198291-2745-4cde-a1a3-58a4bec54df8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029280 Jun 29 16:18:21.588046 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 461/940] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:28.289559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:28.290129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:28.297029 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:28.297478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:28.298235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:28.298670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:28.320981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b136dab6-b967-4c3f-9ce1-c222e4332f7a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.035290 Jun 29 16:18:28.321534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 480/941] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:18:28 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:29.625563 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f66d1f09-c883-4931-8d3b-cdea2b7a3e73"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:29.626731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:29.632934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:29.633380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:29.634132 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:29.634564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:29.892272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc0b4bc8-cd97-49be-bdec-26f91240c10c tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271843 Jun 29 16:18:29.892923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 462/942] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:18:29 2022] POST /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:30.101253 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:30.101752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:30.104386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:30.114627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:30.115180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:30.116162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:30.116956 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:30.121469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=59 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:30.141448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-090bc7cf-37df-4541-b688-b0d5a30aec5b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/ips" status: 200 len: 153 microversion: 2.20 time: 0.044170 Jun 29 16:18:30.142016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 481/943] 10.222.0.47 () {60 vars in 1288 bytes} [Wed Jun 29 16:18:30 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 16:18:31.980087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:31.980714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:31.982644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=27 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:31.989588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:31.990074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:31.990844 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:31.991280 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:31.996016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:32.019361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lazy-loading 'flavor' on Instance uuid 3dd9fd0f-e713-42ac-95a5-271fa28b19dc {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:18:32.290518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c3ed1e94-f34f-4c00-abfd-a258c503b831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/action" status: 202 len: 0 microversion: 2.20 time: 0.315135 Jun 29 16:18:32.291123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 463/944] 10.222.0.47 () {62 vars in 1318 bytes} [Wed Jun 29 16:18:31 2022] POST /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 16:18:32.300669 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:32.301272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:32.308148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:32.308589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:32.309465 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:32.309873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:32.450498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:32.458680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:32.460229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:32.461397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c23f7337-4713-4c18-9830-c3c0655083aa tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.165415 Jun 29 16:18:32.461950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 482/945] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:32 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:33.481645 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:33.482335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:33.488904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:33.489454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:33.490127 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:33.490560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:33.617568 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:33.625971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:33.627489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:33.628655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f5b2946-42da-4144-aaf5-c4909febe26f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.151748 Jun 29 16:18:33.629259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 464/946] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:33 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:34.647136 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:34.647735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:34.654377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:34.654817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:34.655557 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:34.656060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:34.780233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:34.788638 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:34.790123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:34.791260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-28e7333f-154a-484d-a13b-f95761695d62 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.148082 Jun 29 16:18:34.791808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 483/947] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:34 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:35.809549 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:35.810156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:35.817296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:35.817741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:35.818495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:35.818954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:35.956247 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:35.964051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:35.965552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:35.966693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-963d765c-9e8f-4a89-acd5-6bba5b6d576e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.161050 Jun 29 16:18:35.967242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 465/948] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:35 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:36.985983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:36.986905 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:36.994513 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:36.994965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:36.995724 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:36.996183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.133527 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:37.142348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:37.143892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:37.145067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2d728d57-a575-454b-abd7-5047887e86ba tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.164444 Jun 29 16:18:37.145809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 484/949] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:36 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:37.376428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f66d1f09-c883-4931-8d3b-cdea2b7a3e73"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:37.377539 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:37.383953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:37.384393 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.385139 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:37.385842 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.463523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Invalid volume: volume f66d1f09-c883-4931-8d3b-cdea2b7a3e73 is already attached to instances: 24be8382-229e-4cea-8504-fa5b22a825a5 Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments HTTP/1.1 Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 74 Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:18:37.465269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {"volumeAttachment": {"volumeId": "f66d1f09-c883-4931-8d3b-cdea2b7a3e73"}} Jun 29 16:18:37.466925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Invalid volume: volume f66d1f09-c883-4931-8d3b-cdea2b7a3e73 is already attached to instances: 24be8382-229e-4cea-8504-fa5b22a825a5 Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '24be8382-229e-4cea-8504-fa5b22a825a5', 'body': {'volumeAttachment': {'volumeId': 'f66d1f09-c883-4931-8d3b-cdea2b7a3e73'}}} Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f66d1f09-c883-4931-8d3b-cdea2b7a3e73 is already attached to instances: 24be8382-229e-4cea-8504-fa5b22a825a5 Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:18:37.467886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f66d1f09-c883-4931-8d3b-cdea2b7a3e73 is already attached to instances: 24be8382-229e-4cea-8504-fa5b22a825a5 Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:18:37.469335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f66d1f09-c883-4931-8d3b-cdea2b7a3e73 is already attached to instances: 24be8382-229e-4cea-8504-fa5b22a825a5 Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 400 to user: Invalid volume: volume f66d1f09-c883-4931-8d3b-cdea2b7a3e73 is already attached to instances: 24be8382-229e-4cea-8504-fa5b22a825a5 {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5c6a1e26-6d3c-4189-843c-33ed6438e88b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094903 Jun 29 16:18:37.470769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 466/950] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:18:37 2022] POST /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:18:37.527476 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:37.527993 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:37.533890 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:37.534330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.535071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:37.535499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.615647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lazy-loading 'services' on Instance uuid 24be8382-229e-4cea-8504-fa5b22a825a5 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:18:37.686379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7327f77a-1e0a-48c4-a12a-011919aa22b4 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments/f66d1f09-c883-4931-8d3b-cdea2b7a3e73" status: 202 len: 0 microversion: 2.1 time: 0.162572 Jun 29 16:18:37.686955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 485/951] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:18:37 2022] DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments/f66d1f09-c883-4931-8d3b-cdea2b7a3e73 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:18:37.695785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:37.696900 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:37.704406 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:37.704951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.705871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:37.706343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:37.738667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d6c5dbf5-6cae-4ac9-b379-7fc97fa4799b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047366 Jun 29 16:18:37.739211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 467/952] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:18:37 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:38.164165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:38.164909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:38.172858 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.173296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.174656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.175501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.304198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:38.312196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:38.313730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:38.314897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fd74b0f5-381b-49c9-9c8e-052506b1954e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.155117 Jun 29 16:18:38.315458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 486/953] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:38 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:38.750783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:38.751707 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:38.758142 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.758590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.759350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.759787 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.788354 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec6574c3-7ad8-48f0-b17a-bed84665fbf7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042013 Jun 29 16:18:38.788829 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 468/954] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:18:38 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:18:38.844755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:38.845336 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:38.851210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.851659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.852462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.852894 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.878049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:18:38.950849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1720ad00-b1f5-4261-97b6-2d5599aefb1d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 204 len: 0 microversion: 2.1 time: 0.109576 Jun 29 16:18:38.951425 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 487/955] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:18:38 2022] DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:18:38.960202 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:38.960813 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:38.967663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.968144 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:38.969482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:38.969918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:39.096191 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:39.103553 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-48f2017b-5b86-404c-94fc-2a71eb4be536 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1682 microversion: 2.1 time: 0.147192 Jun 29 16:18:39.104624 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 469/956] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:38 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:39.334329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:39.334974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:39.341467 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:39.341918 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:39.342676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:39.343107 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:39.473461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:39.481367 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:39.482883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:39.484066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e9177ae5-b124-48b6-8259-7f9f650391f8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.154189 Jun 29 16:18:39.485239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 488/957] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:39 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:40.119755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:40.120385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:40.127349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:40.127785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:40.128555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:40.128980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:40.256392 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:40.264036 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c0bef57c-e018-43e0-a48c-048c13c07737 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1682 microversion: 2.1 time: 0.148040 Jun 29 16:18:40.264601 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 470/958] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:40 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:40.502704 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:40.503304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:40.509766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:40.510207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:40.511207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:40.511631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:40.638201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:40.646104 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:40.647612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:40.648800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-dcf68fb6-53ab-47fd-b0bb-3bfae5ea8277 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.150689 Jun 29 16:18:40.649354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 489/959] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:40 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:41.283218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:41.283980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:41.290643 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:41.291173 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:41.292054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:41.292606 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:41.522658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:41.530171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f555239-b5a5-4872-81c5-3e64866f8cc7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1682 microversion: 2.1 time: 0.252186 Jun 29 16:18:41.530739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 471/960] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:41 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:41.666581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:41.667239 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:41.681787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:41.682241 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:41.683012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:41.683451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:41.818566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:41.826525 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:41.828050 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:41.829220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0fbf8212-6c0d-4c7c-93f2-0982b066dde0 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.166679 Jun 29 16:18:41.829783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 490/961] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:41 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:41.938903 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-7db6f39d-d3c4-4654-874f-9082b89020d7 req-5f4b3124-2834-4493-9fee-f2302c68440c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24be8382-229e-4cea-8504-fa5b22a825a5", "name": "network-vif-deleted", "tag": "ccfac2a3-6d43-489e-8f3d-4b3e1727b931"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:41.948930 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7db6f39d-d3c4-4654-874f-9082b89020d7 req-5f4b3124-2834-4493-9fee-f2302c68440c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:41.949589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7db6f39d-d3c4-4654-874f-9082b89020d7 req-5f4b3124-2834-4493-9fee-f2302c68440c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:41.966756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-7db6f39d-d3c4-4654-874f-9082b89020d7 req-5f4b3124-2834-4493-9fee-f2302c68440c service nova] Creating event network-vif-deleted:ccfac2a3-6d43-489e-8f3d-4b3e1727b931 for instance 24be8382-229e-4cea-8504-fa5b22a825a5 on hv-cinder-84814 Jun 29 16:18:41.972563 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-7db6f39d-d3c4-4654-874f-9082b89020d7 req-5f4b3124-2834-4493-9fee-f2302c68440c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038474 Jun 29 16:18:41.973358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 472/962] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:42.548391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:42.549360 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:42.556042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:42.556697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:42.557625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:42.558223 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:42.596822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:42.597299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:42.597729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lazy-loading 'fault' on Instance uuid 24be8382-229e-4cea-8504-fa5b22a825a5 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:18:42.643795 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:42.651118 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c1f31741-d23d-4771-982c-c8f2b013a969 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 200 len: 1332 microversion: 2.1 time: 0.107171 Jun 29 16:18:42.651845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 491/963] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:42 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:42.847526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:42.848256 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:42.855048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:42.855490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:42.856283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:42.856713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:42.989858 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:43.002743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:43.004288 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:43.005434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-52325362-9cf6-49ce-a9de-c224b7e54ecf tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.162781 Jun 29 16:18:43.005978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 473/964] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:42 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:43.669173 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:43.669783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:43.676309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:43.676753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:43.677501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:43.677963 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:43.691742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 HTTP/1.1 Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:18:43.693413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:18:43.695059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '24be8382-229e-4cea-8504-fa5b22a825a5'} Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:18:43.695984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:18:43.697449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:18:43.698784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:18:43.698784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8b7fb3c0-2417-4cc0-b24e-62c176ac1a67 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 404 len: 111 microversion: 2.1 time: 0.029482 Jun 29 16:18:43.698784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 492/965] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:43 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:18:43.704284 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c840ecc1-d32d-4db6-aa03-e1d16bc9c727 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '.version_select at 0x7f0434d81a60>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:43.721605 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c840ecc1-d32d-4db6-aa03-e1d16bc9c727 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066142199" status: 202 len: 0 microversion: 2.1 time: 0.021716 Jun 29 16:18:43.722146 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 474/966] 10.222.0.47 () {58 vars in 1220 bytes} [Wed Jun 29 16:18:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066142199 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:18:44.022949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:44.023553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:44.029501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:44.029941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:44.030686 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:44.031113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:44.165342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:44.174013 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:44.175631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:44.176892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-791bcaac-7a6f-4dbd-9ed0-b1b22867df9c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.157818 Jun 29 16:18:44.177526 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 493/967] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:44 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:44.323330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fe2f9c7b-b057-4b37-938b-28ed39d3b81d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: .version_select at 0x7f04395fb8b0>, body: {"keypair": {"name": "tempest-keypair-648369276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbJG89OKWcF3fWnv/ahFlSo6B3NfWtR4kRA9fF4iClp8LcLagrI7T9cyZRzfcZRQFLOqu9crKUMD6Dmcwq1XAGpsm74HMe+iry+xsDG0C+bM07NzvzVvDxqDw5Fxto8Sw=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:44.339240 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-fe2f9c7b-b057-4b37-938b-28ed39d3b81d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:18:44.343089 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-fe2f9c7b-b057-4b37-938b-28ed39d3b81d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:18:44.364621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fe2f9c7b-b057-4b37-938b-28ed39d3b81d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045972 Jun 29 16:18:44.365189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 475/968] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:18:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:45.195195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:45.195817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:45.202570 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:45.203023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:45.204438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:45.204923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:45.630475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:45.638597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:45.640147 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:45.641801 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-700b6db8-78bd-4b16-b25f-ff1922780488 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.450762 Jun 29 16:18:45.642358 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 494/969] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:45 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:45.897303 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1349982301", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d31a991-2d95-49d3-82c4-03bcb2a7b773"}], "security_groups": [{"name": "tempest-securitygroup--2057548699"}], "key_name": "tempest-keypair-648369276", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:45.995470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] validate_networks() for [('1d31a991-2d95-49d3-82c4-03bcb2a7b773', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:18:46.352203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:18:46.352615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:18:46.353104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:18:46.353501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:18:46.353901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:18:46.363248 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:46.363687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:46.364508 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:46.364935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:46.382506 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:18:46.386635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Getting quotas for user 2020c486ef3e4fceb1d671269668ba68 and project f81b8fe398ae4ed19d6b9f49f6490e5a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:18:46.397564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:18:46.399750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:18:46.446668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c334b483-28da-461f-a4f4-77925559a1f8 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.553541 Jun 29 16:18:46.447276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 476/970] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:18:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:18:46.457060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-335bce04-7566-4a8d-8164-6de3c8ca7b4e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:46.457735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-335bce04-7566-4a8d-8164-6de3c8ca7b4e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:46.512397 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-335bce04-7566-4a8d-8164-6de3c8ca7b4e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:46.519300 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-335bce04-7566-4a8d-8164-6de3c8ca7b4e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1241 microversion: 2.1 time: 0.066094 Jun 29 16:18:46.519899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 495/971] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:46 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:46.660621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:46.661271 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:46.667294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:46.667739 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:46.668531 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:46.668970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:46.798214 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:46.806312 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:46.807851 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:46.809011 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b19856ea-becc-4bec-893b-6ccfd8ac2159 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.153030 Jun 29 16:18:46.809558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 477/972] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:46 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:47.535075 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:47.535683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:47.542818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:47.543294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:47.544083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:47.544519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:47.604493 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:47.612134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4752a433-622d-44bd-bab4-51c24d1eebce tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1299 microversion: 2.1 time: 0.080920 Jun 29 16:18:47.612715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 496/973] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:47 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:47.827337 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:47.827884 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:47.834425 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:47.834876 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:47.835635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:47.836097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:48.043621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:48.052023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:48.053522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:48.054684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94c6146c-466e-4b12-86de-a189810df783 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.231346 Jun 29 16:18:48.055209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 478/974] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:47 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:48.630505 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:48.631040 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:48.639365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:48.639881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:48.640602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:48.641041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:48.644342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:48.773700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:48.781191 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9f18b2fa-25e9-449a-9df2-9d199917098b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.155678 Jun 29 16:18:48.781758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 497/975] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:48 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:49.073888 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:49.074588 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:49.082100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:49.083304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:49.084306 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:49.084744 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:49.106435 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-453c5759-ab1b-48f5-a90b-dddb9c645279 req-975a6202-7604-4538-b27e-5c4ec057992b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a97b17d-a69e-4288-8f3c-fbd790f8cce5", "tag": "17e4d95f-713e-4003-9049-864c767c744c"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:49.124739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-453c5759-ab1b-48f5-a90b-dddb9c645279 req-975a6202-7604-4538-b27e-5c4ec057992b service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:49.125474 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-453c5759-ab1b-48f5-a90b-dddb9c645279 req-975a6202-7604-4538-b27e-5c4ec057992b service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:49.149068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-453c5759-ab1b-48f5-a90b-dddb9c645279 req-975a6202-7604-4538-b27e-5c4ec057992b service nova] Creating event network-changed:17e4d95f-713e-4003-9049-864c767c744c for instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 on hv-cinder-84814 Jun 29 16:18:49.160751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-453c5759-ab1b-48f5-a90b-dddb9c645279 req-975a6202-7604-4538-b27e-5c4ec057992b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061260 Jun 29 16:18:49.161357 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 498/976] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:49.275009 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:49.283602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:49.285172 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:49.286332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f9b97568-e26e-4071-81a7-f2eedc722d44 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.216458 Jun 29 16:18:49.287170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 479/977] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:49 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:49.800156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:49.800844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:49.807010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:49.807458 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:49.808262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:49.809248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:49.938048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:49.945608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8e059b80-6090-4a9c-8d45-f50bab28dabe tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.150946 Jun 29 16:18:49.946177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 499/978] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:49 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:50.304292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:50.304965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:50.311498 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:50.311981 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:50.312732 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:50.313160 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:50.443942 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:50.451735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:50.453246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:50.454992 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e4f63b0-b3fa-4d29-9fac-365cfd3c255f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.154554 Jun 29 16:18:50.455530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 480/979] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:50 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:50.962298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:50.962900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:50.969383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:50.969825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:50.970566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:50.970989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:51.100421 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:51.107709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3819c111-cad8-4c0c-bc8d-be26fe60110b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.149276 Jun 29 16:18:51.108299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 500/980] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:50 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:51.473635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:51.474243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:51.480726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:51.481174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:51.481927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:51.482359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:51.486957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:51.615282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:51.623072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:51.624595 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:51.625765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa1a6429-53d5-443b-a517-a58f5532c38e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.156525 Jun 29 16:18:51.626307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 481/981] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:51 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:52.124966 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:52.126166 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:52.132303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:52.132751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:52.133510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:52.133940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:52.264616 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:52.272951 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-45b145c9-a866-446c-8f82-1d962616e5f2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.151812 Jun 29 16:18:52.273529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 501/982] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:52 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:52.644075 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:52.644621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:52.650977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:52.651420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:52.652259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:52.652687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:52.778049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:52.786515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:52.788057 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:52.789208 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7c5bec88-6f7f-433b-8ba1-10f80617c1f5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.149096 Jun 29 16:18:52.789767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 482/983] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:52 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:53.290016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:53.290635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:53.297899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:53.298345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:53.299294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:53.299935 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:53.443686 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:53.451565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-baacff3f-dd55-4bd7-9dab-e45b44711428 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.165499 Jun 29 16:18:53.452177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 502/984] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:53 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:53.806956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:53.807559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:53.814650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:53.815096 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:53.815873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:53.816306 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:54.012575 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:54.021024 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:54.022548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:54.023701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fbe92305-312e-4929-a023-cdf0a96ac950 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.220746 Jun 29 16:18:54.024292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 483/985] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:53 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:54.468558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:54.469168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:54.476168 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:54.476613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:54.477409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:54.477843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:54.520719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-306c6149-fa89-44a5-8185-4fbc6bdb11ab req-0ee155fe-0667-436d-98e0-58cd73c9b235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "name": "network-vif-plugged", "status": "completed", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:54.542855 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-306c6149-fa89-44a5-8185-4fbc6bdb11ab req-0ee155fe-0667-436d-98e0-58cd73c9b235 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:54.544623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-306c6149-fa89-44a5-8185-4fbc6bdb11ab req-0ee155fe-0667-436d-98e0-58cd73c9b235 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:54.560584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-306c6149-fa89-44a5-8185-4fbc6bdb11ab req-0ee155fe-0667-436d-98e0-58cd73c9b235 service nova] Creating event network-vif-plugged:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:18:54.567412 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-306c6149-fa89-44a5-8185-4fbc6bdb11ab req-0ee155fe-0667-436d-98e0-58cd73c9b235 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051131 Jun 29 16:18:54.568450 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 484/986] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:18:54.637554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:54.646802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-994dc0e6-2e80-4d62-a777-43a501317e2f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.182059 Jun 29 16:18:54.647559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 503/987] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:54 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:55.042749 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:55.043467 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:55.049743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:55.050183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:55.050931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:55.051359 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:55.184263 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:55.193168 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:55.194664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:55.195815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f65449ca-4d8f-4417-8e44-1cd5a251b6a7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.157841 Jun 29 16:18:55.196660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 485/988] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:55 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:55.663982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:55.664593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:55.671063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:55.671512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:55.672287 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:55.673371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:55.798758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:55.806088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-26fc6d20-1f30-4109-a408-4f1953bce689 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.145994 Jun 29 16:18:55.806646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 504/989] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:55 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:56.214361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:56.214956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:56.221995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:56.222431 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:56.223177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:56.223602 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:56.357012 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:56.365105 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:56.366619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:56.367771 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8b33793e-5490-4506-9790-f96f81391892 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1746 microversion: 2.20 time: 0.157291 Jun 29 16:18:56.368349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 486/990] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:56 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:56.583533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-7d971a8d-20bf-4034-a392-72415629ec33 req-84822c81-3dab-4b4d-9059-699ede7332d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a97b17d-a69e-4288-8f3c-fbd790f8cce5", "name": "network-vif-plugged", "status": "completed", "tag": "17e4d95f-713e-4003-9049-864c767c744c"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:18:56.587255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:56.593732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-7d971a8d-20bf-4034-a392-72415629ec33 req-84822c81-3dab-4b4d-9059-699ede7332d4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:56.594174 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-7d971a8d-20bf-4034-a392-72415629ec33 req-84822c81-3dab-4b4d-9059-699ede7332d4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:56.606497 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-7d971a8d-20bf-4034-a392-72415629ec33 req-84822c81-3dab-4b4d-9059-699ede7332d4 service nova] Creating event network-vif-plugged:17e4d95f-713e-4003-9049-864c767c744c for instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 on hv-cinder-84814 Jun 29 16:18:56.613538 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-7d971a8d-20bf-4034-a392-72415629ec33 req-84822c81-3dab-4b4d-9059-699ede7332d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Jun 29 16:18:56.614438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 505/991] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:56.822486 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:56.823085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:56.826070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:56.826704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:56.832719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:56.833165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:56.833916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:56.834554 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:56.991250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:56.999301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5a871d5f-0bd3-41f4-a4df-cb1a3b22b53d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.180623 Jun 29 16:18:56.999869 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 487/992] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:56 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:57.387809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:57.389653 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:57.396534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:57.397547 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:57.399748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:57.400254 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:57.554943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:57.563427 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:57.565449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:57.566703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-48d7072c-bcf8-43b4-9368-b4627a46e7cd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.184077 Jun 29 16:18:57.567511 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 506/993] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:57 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:58.017267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:58.017868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:58.024827 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:58.025482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:58.026244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:58.026675 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:58.168655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:58.176969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cf051d85-f2b4-4825-85b7-1b45104b96a5 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1367 microversion: 2.1 time: 0.163655 Jun 29 16:18:58.177574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 488/994] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:58 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:58.585369 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:58.585966 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:58.592673 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:58.593367 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:58.594311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:58.594750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:58.731451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:58.741784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:58.743539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:58.744723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cabacec0-8775-41e0-8a65-f8e148ddee3f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.163315 Jun 29 16:18:58.745631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 507/995] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:58 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:18:59.194314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:59.195537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:59.202166 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:59.202622 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:59.203515 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:59.204866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:59.351305 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:59.363615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24816243-ff09-4e11-9ad3-3dec39ad603b tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1556 microversion: 2.1 time: 0.173527 Jun 29 16:18:59.378545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 489/996] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:18:59 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:18:59.383329 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:59.384145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:59.392408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:59.393337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:59.394245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:59.394754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:59.476808 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-45fa0404-5cf6-4cab-966e-99ddd0ada3f7 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097634 Jun 29 16:18:59.477411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 508/997] 10.222.0.47 () {58 vars in 1274 bytes} [Wed Jun 29 16:18:59 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:18:59.762927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:18:59.763538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:18:59.770184 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:59.770643 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:59.771413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:18:59.772043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:18:59.919629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:59.931346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:59.933019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:18:59.935282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-21eb9478-7a4c-4801-be81-978d97b94085 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.176125 Jun 29 16:18:59.936658 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 490/998] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:18:59 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:00.548335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-f5a7f483-64b0-4c31-a8c9-dd242fefcbea req-deed186a-bf29-4dac-a0ae-2cdeefe5f858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a97b17d-a69e-4288-8f3c-fbd790f8cce5", "tag": "17e4d95f-713e-4003-9049-864c767c744c"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:00.555611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:00.557859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-f5a7f483-64b0-4c31-a8c9-dd242fefcbea req-deed186a-bf29-4dac-a0ae-2cdeefe5f858 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:00.558610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-f5a7f483-64b0-4c31-a8c9-dd242fefcbea req-deed186a-bf29-4dac-a0ae-2cdeefe5f858 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:00.573914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-f5a7f483-64b0-4c31-a8c9-dd242fefcbea req-deed186a-bf29-4dac-a0ae-2cdeefe5f858 service nova] Creating event network-changed:17e4d95f-713e-4003-9049-864c767c744c for instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 on hv-cinder-84814 Jun 29 16:19:00.579979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-f5a7f483-64b0-4c31-a8c9-dd242fefcbea req-deed186a-bf29-4dac-a0ae-2cdeefe5f858 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035382 Jun 29 16:19:00.581137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 509/999] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:00.963842 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:00.965774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:00.976714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:00.977516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:00.978984 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:00.979807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:01.270612 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:01.287449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:01.292761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:01.294283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94b77165-d83a-49f7-8528-f0d3ff139686 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.340683 Jun 29 16:19:01.305688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 491/1000] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:00 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:02.314589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:02.316195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:02.322701 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:02.323151 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:02.323954 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:02.324393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:02.462952 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:02.471379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:02.472934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:02.474071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-79243211-3c6f-4974-977e-4957aeaec5bd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.164566 Jun 29 16:19:02.474631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 510/1001] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:02 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:03.492812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:03.494119 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:03.496955 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:03.503980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:03.504419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:03.505197 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:03.505629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:03.662000 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:03.669940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:03.671474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:03.672711 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-87a938b5-0418-4e0b-b72d-59e90710b001 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.183964 Jun 29 16:19:03.673674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 492/1002] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:03 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:04.691039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:04.691652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:04.698220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:04.698663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:04.699436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:04.699869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:04.836675 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:04.844943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:04.846465 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:04.847691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1bdc497f-7717-4047-9825-0ac7537dff69 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.161094 Jun 29 16:19:04.848298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 511/1003] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:04 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:05.866622 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:05.868001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:05.874921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:05.875477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:05.876383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:05.876890 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:06.013726 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:06.022875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:06.024631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:06.025833 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b9e5a368-d310-4a53-b1ca-1ff5c7303e00 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.163830 Jun 29 16:19:06.026381 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 493/1004] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:05 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:07.045176 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:07.046303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:07.054310 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:07.055054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:07.056079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:07.056740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:07.199175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:07.209179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:07.211250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:07.217033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d7acdf6b-de57-4757-9b9b-da6f7e53d30f tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.174760 Jun 29 16:19:07.218206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 512/1005] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:07 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:08.236738 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:08.237362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:08.244044 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:08.244497 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:08.245254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:08.245689 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:08.379084 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:08.387185 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:08.388724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:08.389873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a0b68b9-c4b4-4b1e-ad1f-41223970beca tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1741 microversion: 2.20 time: 0.157743 Jun 29 16:19:08.390426 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 494/1006] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:08 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:09.408271 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:09.408807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:09.415363 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:09.415809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:09.416585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:09.417218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:09.550975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:09.558802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:09.560316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:09.561490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d15fd699-ecb9-4a55-8645-fe43e978acf5 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1723 microversion: 2.20 time: 0.157264 Jun 29 16:19:09.562040 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 513/1007] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:09 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:10.531097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8719ddc7-1671-4bd5-8c7e-e80953636352 req-a7363061-db6b-446f-8f49-115bfa1af0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "name": "network-vif-unplugged", "status": "completed", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:10.539944 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8719ddc7-1671-4bd5-8c7e-e80953636352 req-a7363061-db6b-446f-8f49-115bfa1af0ff service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:10.540393 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8719ddc7-1671-4bd5-8c7e-e80953636352 req-a7363061-db6b-446f-8f49-115bfa1af0ff service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:10.552380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8719ddc7-1671-4bd5-8c7e-e80953636352 req-a7363061-db6b-446f-8f49-115bfa1af0ff service nova] Creating event network-vif-unplugged:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:19:10.557319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8719ddc7-1671-4bd5-8c7e-e80953636352 req-a7363061-db6b-446f-8f49-115bfa1af0ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029886 Jun 29 16:19:10.557904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 495/1008] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:19:10.580475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:10.581082 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:10.587596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:10.588076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:10.588828 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:10.589250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:10.717232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:10.725535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:10.727029 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:10.728201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b4d29603-0129-4005-8d09-f12aa63460e8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1723 microversion: 2.20 time: 0.151674 Jun 29 16:19:10.728751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 514/1009] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:10 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:11.747936 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:11.748660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:11.755512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:11.755980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:11.756729 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:11.757158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:11.883081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:11.891207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:11.892785 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:11.893935 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3032a0e0-f7a9-4607-a551-00d3bb005c27 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1666 microversion: 2.20 time: 0.150735 Jun 29 16:19:11.894489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 496/1010] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:11 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:11.911272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15759096-4915-4cbc-8550-61e43c5bc94f"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:11.912441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:11.918776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:11.919215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:11.919985 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:11.920413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.000592 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:12.179763 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6d9ebab2-5316-4354-83b2-79f85474d2b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.272510 Jun 29 16:19:12.180394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 515/1011] 10.222.0.47 () {62 vars in 1363 bytes} [Wed Jun 29 16:19:11 2022] POST /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-volume_attachments => generated 188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 16:19:12.290860 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:12.291386 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:12.297331 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:12.297776 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.298528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:12.299599 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.396185 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:12.555466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac865b05-8a3a-4c0c-bf5e-905d397dccb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-volume_attachments/15759096-4915-4cbc-8550-61e43c5bc94f" status: 202 len: 0 microversion: 2.20 time: 0.268497 Jun 29 16:19:12.556205 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 497/1012] 10.222.0.47 () {60 vars in 1456 bytes} [Wed Jun 29 16:19:12 2022] DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-volume_attachments/15759096-4915-4cbc-8550-61e43c5bc94f => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:19:12.611330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:12.612012 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:12.618156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:12.618606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.619400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:12.619859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.708475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-227f9e77-6093-4da2-a601-fadd6715d32d tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "POST /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/action" status: 202 len: 0 microversion: 2.20 time: 0.101070 Jun 29 16:19:12.709077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 516/1013] 10.222.0.47 () {62 vars in 1318 bytes} [Wed Jun 29 16:19:12 2022] POST /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:19:12.717132 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:12.717743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:12.727519 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:12.728224 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.729163 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:12.729755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:12.857924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:12.866131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:12.867630 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:12.868846 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c38d8b7-56e8-4a8c-8471-606d4595aa49 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1674 microversion: 2.20 time: 0.155652 Jun 29 16:19:12.869395 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 498/1014] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:12 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:13.888394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:13.889038 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:13.894991 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:13.895437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:13.896226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:13.896663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:14.026976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:14.036141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:14.037677 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:14.038818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f19e0df4-147c-4bb8-823d-0ff4425fd831 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.155257 Jun 29 16:19:14.039364 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 517/1015] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:13 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:15.057807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:15.058434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:15.064954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:15.065910 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:15.066666 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:15.067227 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:15.201837 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:15.210209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:15.211699 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:15.213085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1742aeec-b593-4a5a-92d2-905c197d2387 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.159479 Jun 29 16:19:15.213940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 499/1016] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:15 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:16.231976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:16.232575 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:16.239564 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:16.240802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:16.241946 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:16.242594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:16.379240 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:16.387837 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:16.389471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:16.390626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4d31a8e1-ba95-4297-8a80-bf5a6b81896e tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.162564 Jun 29 16:19:16.391279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 518/1017] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:16 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:17.409167 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:17.410339 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:17.418623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:17.419239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:17.420310 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:17.420871 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:17.569735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:17.577638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:17.579135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:17.580299 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f02782af-7b9b-44ee-8129-51127640a4a9 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.175298 Jun 29 16:19:17.580852 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 500/1018] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:17 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:18.605256 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:18.606844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:18.616039 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:18.616583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:18.617570 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:18.618065 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:18.760921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:18.772071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:18.773688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:18.775044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f8b96910-1920-49e1-a1b6-c30f580aab7c tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.176296 Jun 29 16:19:18.775649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 519/1019] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:18 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:19.460065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:19.460592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:19.467077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:19.467530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:19.468337 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:19.468781 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:19.492715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d6d670ae-8d98-4c76-8025-5fc8fdec3847 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/ips" status: 200 len: 144 microversion: 2.1 time: 0.036701 Jun 29 16:19:19.493459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 501/1020] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:19:19 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:19.793272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:19.794747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:19.803415 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:19.804252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:19.806100 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:19.806775 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:19.943142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:19.951130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:19.952659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:19.953827 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-69b6695a-4764-470b-b99d-3db5c23cf3c1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.164444 Jun 29 16:19:19.954372 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 520/1021] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:19 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:20.973103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:20.975297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:20.983503 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:20.984151 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:20.985349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:20.985846 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:21.124528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:21.133007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:21.134517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:21.135667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f3a11f7a-4c33-4fe5-8f20-cd7693a7446b tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.167447 Jun 29 16:19:21.136258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 502/1022] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:20 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:21.886733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de3f9dbb-d49b-48fc-b158-382f1f3c17e7"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:21.888859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:21.896499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:21.897210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:21.898153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:21.898736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:22.153870 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:22.155223 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:22.164741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:22.165606 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:22.166759 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:22.167474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:22.307999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:22.315784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:22.317827 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:22.318989 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-690a0f53-4519-47ed-8bba-e355f8bbe3f1 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.169100 Jun 29 16:19:22.319538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 503/1023] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:22 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:23.339001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:23.339674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:23.346212 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:23.346655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:23.347411 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:23.347895 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:23.482327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:23.490267 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:23.491783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:23.493116 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fdf652ff-b0be-428c-8054-48543e448477 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.157858 Jun 29 16:19:23.493842 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 504/1024] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:23 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:24.511246 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:24.511918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:24.518650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:24.519092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:24.519860 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:24.520315 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:24.663731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:24.673872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:24.675388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:24.676583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9cd71edf-5f1b-4bf1-a0e0-8201cc575645 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.169463 Jun 29 16:19:24.677149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 505/1025] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:24 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:25.694753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:25.695399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:25.701932 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:25.702372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:25.703121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:25.703542 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:25.832553 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:25.841585 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:25.843676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:25.845200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b5c0b862-c89c-44ec-b636-af46ea37c152 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.154423 Jun 29 16:19:25.851791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 506/1026] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:25 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:26.864993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:26.865676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:26.872118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:26.872565 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:26.873318 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:26.873750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:27.000238 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:27.008586 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:27.010079 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:27.011218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ceddf5d5-7fd7-4813-9b5f-380a1956da12 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.150129 Jun 29 16:19:27.011769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 507/1027] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:26 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:28.030118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:28.030790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:28.037226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:28.038270 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:28.039023 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:28.039455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:28.167750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:28.175629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:28.177169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:28.178314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79d61f2d-6896-4fa4-acb9-ee0af1148621 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.152159 Jun 29 16:19:28.178872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 508/1028] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:28 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:29.196307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:29.196897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:29.203241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:29.203682 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:29.204459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:29.204882 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:29.333484 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:29.341800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:29.343222 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:29.344405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e3711858-4c58-4250-8607-288c4869dcfb tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.152034 Jun 29 16:19:29.344962 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 509/1029] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:29 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:30.362479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:30.363152 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:30.370545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:30.371068 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:30.371816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:30.372268 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:30.503554 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:30.511435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:30.513236 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:30.514374 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24b3e9c3-999c-4cea-8d1c-dae67d96a7de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.155823 Jun 29 16:19:30.514927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 510/1030] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:30 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:31.532520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:31.533210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:31.539567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:31.540049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:31.540808 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:31.541242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:31.669901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:31.677777 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:31.679783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:31.680941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8c62bd1f-20b5-4e22-825a-ac7d024366dd tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.152333 Jun 29 16:19:31.681494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 511/1031] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:31 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:31.896624 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=27 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:31.969574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=48,nova_cell1:UPDATE=5 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:32.699343 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:32.699983 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:32.706513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:32.706951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:32.707697 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:32.708150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:32.841157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:32.841760 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c9cf1ef7-5692-461b-9e23-3d69f3610a18 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.959041 Jun 29 16:19:32.842625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 521/1032] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:19:21 2022] POST /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments => generated 194 bytes in 10961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:32.849691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:32.851204 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:32.852470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1213ffeb-45ef-4010-a7c5-a676aae4d06a tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.157511 Jun 29 16:19:32.853362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 512/1033] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:32 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 16:19:33.871563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:33.872181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:33.878612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:33.879078 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:33.879850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:33.880285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:34.008777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:34.016779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:34.018273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:34.019419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-21cfe88c-e284-4755-b200-fcd8b84353f7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.152804 Jun 29 16:19:34.019992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 522/1034] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:33 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:35.037269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:35.037878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:35.040316 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=42 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:35.046031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:35.046483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:35.047244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:35.047681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:35.067762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=96,nova_cell1:UPDATE=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:35.189529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:35.198030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:35.199536 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:35.200717 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d56f88a-b8d6-4517-bc8b-02fb9fdadaac tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.167313 Jun 29 16:19:35.201457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 513/1035] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:35 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:36.219436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:36.220076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:36.227314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:36.227761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:36.228545 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:36.228982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:36.357281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:36.365160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:36.366708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:36.367871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6bee48e3-140e-4f36-846b-a65b6f0b3a10 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.152366 Jun 29 16:19:36.368419 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 523/1036] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:36 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:36.704650 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-913b3f64-c244-4042-842f-c90a7dce340b req-da2faa14-e6c8-4734-9576-2d9c39d78f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "name": "network-vif-plugged", "status": "completed", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:36.714014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-913b3f64-c244-4042-842f-c90a7dce340b req-da2faa14-e6c8-4734-9576-2d9c39d78f53 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:36.714589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-913b3f64-c244-4042-842f-c90a7dce340b req-da2faa14-e6c8-4734-9576-2d9c39d78f53 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:36.726031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-913b3f64-c244-4042-842f-c90a7dce340b req-da2faa14-e6c8-4734-9576-2d9c39d78f53 service nova] Creating event network-vif-plugged:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:19:36.731219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-913b3f64-c244-4042-842f-c90a7dce340b req-da2faa14-e6c8-4734-9576-2d9c39d78f53 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030369 Jun 29 16:19:36.731998 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 514/1037] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:37.385779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:37.386371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:37.393481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:37.393929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:37.394676 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:37.395101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:37.523386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:37.531200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:37.532729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:37.533864 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0ac5f9a4-1e4f-4e17-b288-ad36761e61ea tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.152026 Jun 29 16:19:37.534417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 524/1038] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:37 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:38.553622 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:38.554954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:38.561733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:38.562176 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:38.562928 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:38.563356 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:38.702541 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:38.715272 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:38.716823 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:38.717987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-55722b6a-c3fe-4df6-946c-3db8dc804375 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1732 microversion: 2.20 time: 0.168626 Jun 29 16:19:38.718536 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 515/1039] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:38 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:39.735901 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:39.736490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:39.743054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:39.743508 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:39.744281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:39.744739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:39.871788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:39.879693 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:39.881298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:39.883098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d21da4f6-0474-4d48-9fce-af2a88aab150 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1719 microversion: 2.20 time: 0.150484 Jun 29 16:19:39.883685 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 525/1040] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:19:39 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:19:40.330643 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:40.331569 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:40.338066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:40.338583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:40.339342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:40.339777 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:40.369108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40809b5a-984c-4213-a9dc-126a73a35cff tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Jun 29 16:19:40.369654 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 516/1041] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:19:40 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:40.379548 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:40.380129 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:40.386113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:40.386566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:40.387372 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:40.388196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:40.417472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-54cec0cd-02c4-42f4-8b56-cffe2194afcd tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/de3f9dbb-d49b-48fc-b158-382f1f3c17e7" status: 200 len: 194 microversion: 2.1 time: 0.041990 Jun 29 16:19:40.418052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 526/1042] 10.222.0.47 () {58 vars in 1412 bytes} [Wed Jun 29 16:19:40 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/de3f9dbb-d49b-48fc-b158-382f1f3c17e7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:41.722958 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be43e0cd-c03a-417c-85dc-29fea00df66a"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:41.724103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:41.731275 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:41.731727 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:41.732513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:41.732946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:41.980514 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-324ec3f8-c04a-47c9-bf3b-0ec4eca8a1a9 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "POST /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261068 Jun 29 16:19:41.981110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 517/1043] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:19:41 2022] POST /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:49.458217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:49.459213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:49.465816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:49.466260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:49.467011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:49.467442 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:49.497015 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-588fada4-6aef-4e65-849b-770433d204bf tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042743 Jun 29 16:19:49.498093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 527/1044] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:19:49 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:49.636498 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:49.637032 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:49.644954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:49.645402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:49.646149 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:49.646579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:49.674118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-20a2b2af-7a0a-4a4d-b6f7-c30a756ba14d tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/de3f9dbb-d49b-48fc-b158-382f1f3c17e7" status: 200 len: 194 microversion: 2.1 time: 0.042114 Jun 29 16:19:49.674676 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 518/1045] 10.222.0.47 () {58 vars in 1412 bytes} [Wed Jun 29 16:19:49 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/de3f9dbb-d49b-48fc-b158-382f1f3c17e7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:49.684102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:49.684589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:49.690953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:49.691395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:49.692158 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:49.692585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:49.922711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lazy-loading 'services' on Instance uuid 663fa951-d347-4f0e-941f-5040e715a534 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:19:49.995743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-428429cd-bf53-4444-b1e0-8c993f26b59c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/de3f9dbb-d49b-48fc-b158-382f1f3c17e7" status: 202 len: 0 microversion: 2.1 time: 0.315290 Jun 29 16:19:49.996366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 528/1046] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:19:49 2022] DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/de3f9dbb-d49b-48fc-b158-382f1f3c17e7 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:19:52.158452 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:52.159009 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:52.165534 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:52.165977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:52.166725 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:52.167159 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:52.195323 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f368307-7951-48cf-99c7-7ed62352cdfa tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/be43e0cd-c03a-417c-85dc-29fea00df66a" status: 200 len: 194 microversion: 2.1 time: 0.041447 Jun 29 16:19:52.195909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 519/1047] 10.222.0.47 () {58 vars in 1412 bytes} [Wed Jun 29 16:19:52 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/be43e0cd-c03a-417c-85dc-29fea00df66a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:52.206856 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:52.207433 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:52.213587 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:52.214024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:52.214766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:52.215194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:52.292711 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lazy-loading 'services' on Instance uuid 663fa951-d347-4f0e-941f-5040e715a534 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:19:52.361733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-aba6889e-3c02-4b21-a523-b78b02715b6a tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/be43e0cd-c03a-417c-85dc-29fea00df66a" status: 202 len: 0 microversion: 2.1 time: 0.159367 Jun 29 16:19:52.362311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 529/1048] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:19:52 2022] DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments/be43e0cd-c03a-417c-85dc-29fea00df66a => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:19:53.519564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:53.520688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:53.527115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.527559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.528342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.529367 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.557791 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63d56b22-3604-4e34-893b-07dae0fef471 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042005 Jun 29 16:19:53.558248 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 520/1049] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:19:53 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:19:53.669774 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:53.670819 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:53.677315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.677764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.678535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.678971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.708411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e0ecf046-380d-4227-95aa-006389eb1b76 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043987 Jun 29 16:19:53.708974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 530/1050] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:19:53 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:19:53.765444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:53.765940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:53.771969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.772419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.773175 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.773814 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.799087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:19:53.873027 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4add2545-341c-4acf-be73-994149d5c51c tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 204 len: 0 microversion: 2.1 time: 0.111060 Jun 29 16:19:53.873465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 521/1051] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:19:53 2022] DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:19:53.882128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:53.882736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:53.889389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.889839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:53.890597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:53.891036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:54.017536 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:54.025043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8c0522b9-a0ee-4a42-9802-fbb65c216571 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1672 microversion: 2.1 time: 0.146799 Jun 29 16:19:54.025610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 531/1052] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:19:53 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:19:55.043316 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:55.044037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:55.050054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:55.050501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:55.051254 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:55.051687 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:55.231949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:55.239348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4289785d-645a-4d53-bc51-1cabad26787e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1672 microversion: 2.1 time: 0.200755 Jun 29 16:19:55.240051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 522/1053] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:19:55 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:19:56.256971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:56.257575 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:56.265143 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:56.266573 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:56.267365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:56.267881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:56.352594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:19:56.352863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Wed Jun 29 16:19:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 (ip 10.222.0.47) !!! Jun 29 16:19:56.400026 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:56.408096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1f97b6d3-5ecb-47cd-ba76-ac95305dc3c5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1672 microversion: 2.1 time: 0.154960 Jun 29 16:19:56.408666 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 532/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:19:56 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:19:57.257626 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-56b13350-f2e6-41b0-a3ff-80e57babee4e req-a37785d9-823f-4d01-9016-8fb30787c4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663fa951-d347-4f0e-941f-5040e715a534", "name": "network-vif-deleted", "tag": "0adfcfe5-9630-4815-8d20-4641f9ad5f94"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:19:57.267445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-56b13350-f2e6-41b0-a3ff-80e57babee4e req-a37785d9-823f-4d01-9016-8fb30787c4ca service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:57.268006 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-56b13350-f2e6-41b0-a3ff-80e57babee4e req-a37785d9-823f-4d01-9016-8fb30787c4ca service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:57.279159 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-56b13350-f2e6-41b0-a3ff-80e57babee4e req-a37785d9-823f-4d01-9016-8fb30787c4ca service nova] Creating event network-vif-deleted:0adfcfe5-9630-4815-8d20-4641f9ad5f94 for instance 663fa951-d347-4f0e-941f-5040e715a534 on hv-cinder-84814 Jun 29 16:19:57.284346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-56b13350-f2e6-41b0-a3ff-80e57babee4e req-a37785d9-823f-4d01-9016-8fb30787c4ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030308 Jun 29 16:19:57.285157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 523/1055] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:19:57.425983 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:57.426802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:57.433454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:57.433964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:57.434832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:57.435335 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:57.466825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:57.467036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:57.467476 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lazy-loading 'fault' on Instance uuid 663fa951-d347-4f0e-941f-5040e715a534 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:19:57.514273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45e8b15637406eb145ca6e756e1f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa6a9273bf24c67bfc20849da531320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:19:57.521979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3a565305-e22d-464e-9f33-0e956e7a6241 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 200 len: 1327 microversion: 2.1 time: 0.099995 Jun 29 16:19:57.522552 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 533/1056] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:19:57 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:19:58.540728 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:58.541421 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:19:58.548128 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:58.548579 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:58.549330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:19:58.549763 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:19:58.563715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] HTTP exception thrown: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Request method failure captured: Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 HTTP/1.1 Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlaphCGE5jeIouuboiqB6H0-4iIy5-jFqOlEOXSPnk5wECeOipVd19rtnNBpwJdUNfd-2sre5uRCCMbHuu60paD9rhQi0MCOrZR_gDP06Xck2noLbG5sdccnWnRn1dPfuFmvyvAKqINKPA2NjH4SzmCcyaa4WAPpxG6Ye-NwrXe2bQ Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:19:58.565357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3fa6a9273bf24c67bfc20849da531320", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 5b45e8b15637406eb145ca6e756e1f44 Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:19:58.566960 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '663fa951-d347-4f0e-941f-5040e715a534'} Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:19:58.567921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:19:58.569442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:19:58.571134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Returning 404 to user: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:19:58.571134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-694930d9-bb84-4db2-8667-8b95004b9566 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 404 len: 111 microversion: 2.1 time: 0.030779 Jun 29 16:19:58.571134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 524/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:19:58 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:19:58.575316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7163ccd7-0b98-4817-b1a2-102fae9cabc5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '.version_select at 0x7f0434c54430>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:19:58.594921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7163ccd7-0b98-4817-b1a2-102fae9cabc5 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851900576" status: 202 len: 0 microversion: 2.1 time: 0.023331 Jun 29 16:19:58.595461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 534/1058] 10.222.0.47 () {58 vars in 1217 bytes} [Wed Jun 29 16:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851900576 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:20:01.445298 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:01.445824 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:01.452396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:01.453055 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:01.454327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:01.454932 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:01.470756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] HTTP exception thrown: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Request method failure captured: Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 HTTP/1.1 Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlaphCGE5jeIouuboiqB6H0-4iIy5-jFqOlEOXSPnk5wECeOipVd19rtnNBpwJdUNfd-2sre5uRCCMbHuu60paD9rhQi0MCOrZR_gDP06Xck2noLbG5sdccnWnRn1dPfuFmvyvAKqINKPA2NjH4SzmCcyaa4WAPpxG6Ye-NwrXe2bQ Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:01.472319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3fa6a9273bf24c67bfc20849da531320", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 5b45e8b15637406eb145ca6e756e1f44 Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.473921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '663fa951-d347-4f0e-941f-5040e715a534'} Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:01.474986 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.476566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.478335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Returning 404 to user: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:01.478335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b61813b0-c56d-4f63-8c22-35977d825ece tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 404 len: 111 microversion: 2.1 time: 0.032250 Jun 29 16:20:01.478335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 525/1059] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:01 2022] DELETE /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:01.483463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:01.484104 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 663fa951-d347-4f0e-941f-5040e715a534] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:01.490788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:01.491235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:01.492017 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:01.492479 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:01.505504 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] HTTP exception thrown: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Request method failure captured: Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 HTTP/1.1 Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlaphCGE5jeIouuboiqB6H0-4iIy5-jFqOlEOXSPnk5wECeOipVd19rtnNBpwJdUNfd-2sre5uRCCMbHuu60paD9rhQi0MCOrZR_gDP06Xck2noLbG5sdccnWnRn1dPfuFmvyvAKqINKPA2NjH4SzmCcyaa4WAPpxG6Ye-NwrXe2bQ Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:01.507110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3fa6a9273bf24c67bfc20849da531320", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 5b45e8b15637406eb145ca6e756e1f44 Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.508723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '663fa951-d347-4f0e-941f-5040e715a534'} Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:01.509776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. Jun 29 16:20:01.511260 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:01.512812 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Returning 404 to user: Instance 663fa951-d347-4f0e-941f-5040e715a534 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:01.512812 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-19c9ba21-169c-45e9-9dab-eb655025612e tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534" status: 404 len: 111 microversion: 2.1 time: 0.030234 Jun 29 16:20:01.512812 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 535/1060] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:01 2022] GET /compute/v2.1/servers/663fa951-d347-4f0e-941f-5040e715a534 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:02.642440 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:02.642921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:02.649548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:02.649995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:02.650747 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:02.651183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:02.668211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] HTTP exception thrown: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Request method failure captured: Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 HTTP/1.1 Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlaphCGE5jeIouuboiqB6H0-4iIy5-jFqOlEOXSPnk5wECeOipVd19rtnNBpwJdUNfd-2sre5uRCCMbHuu60paD9rhQi0MCOrZR_gDP06Xck2noLbG5sdccnWnRn1dPfuFmvyvAKqINKPA2NjH4SzmCcyaa4WAPpxG6Ye-NwrXe2bQ Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:02.670712 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3fa6a9273bf24c67bfc20849da531320", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 5b45e8b15637406eb145ca6e756e1f44 Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.672389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '6c82fec7-271e-4a90-82ae-0425c0c53431'} Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:02.673276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.674537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.675811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Returning 404 to user: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:02.675811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ceb6fcd5-f60c-410b-ae93-4f289ea419bb tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 404 len: 111 microversion: 2.1 time: 0.033717 Jun 29 16:20:02.675811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 526/1061] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:02 2022] DELETE /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:02.680626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:02.681272 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] [instance: 6c82fec7-271e-4a90-82ae-0425c0c53431] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:02.683626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:02.688853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:02.689299 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:02.690059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:02.690534 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:02.693803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:02.706243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] HTTP exception thrown: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Request method failure captured: Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 HTTP/1.1 Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlaphCGE5jeIouuboiqB6H0-4iIy5-jFqOlEOXSPnk5wECeOipVd19rtnNBpwJdUNfd-2sre5uRCCMbHuu60paD9rhQi0MCOrZR_gDP06Xck2noLbG5sdccnWnRn1dPfuFmvyvAKqINKPA2NjH4SzmCcyaa4WAPpxG6Ye-NwrXe2bQ Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:02.707811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3fa6a9273bf24c67bfc20849da531320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3fa6a9273bf24c67bfc20849da531320", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 3fa6a9273bf24c67bfc20849da531320 Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1342727613 Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 5b45e8b15637406eb145ca6e756e1f44 Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeTestJSON-1342727613-project Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.709423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '6c82fec7-271e-4a90-82ae-0425c0c53431'} Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:02.710306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. Jun 29 16:20:02.711750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:02.713178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] Returning 404 to user: Instance 6c82fec7-271e-4a90-82ae-0425c0c53431 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:02.713178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-634d884b-4b57-4c06-ac79-b758b1096822 tempest-AttachVolumeTestJSON-1342727613 tempest-AttachVolumeTestJSON-1342727613-project] 10.222.0.47 "GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431" status: 404 len: 111 microversion: 2.1 time: 0.032455 Jun 29 16:20:02.713178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 536/1062] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:02 2022] GET /compute/v2.1/servers/6c82fec7-271e-4a90-82ae-0425c0c53431 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:06.744580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9ffa7d96-7c01-4c6d-b72d-797c65fc69c2 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Action: 'create', calling method: .version_select at 0x7f0434eb4700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1465280843"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:07.023294 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9ffa7d96-7c01-4c6d-b72d-797c65fc69c2 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.390929 Jun 29 16:20:07.028205 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 527/1063] 10.222.0.47 () {60 vars in 1154 bytes} [Wed Jun 29 16:20:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 16:20:07.034061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b15804e1-0e1d-4fc2-8a29-9c9199c94722 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f04375f2ca0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:07.088886 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b15804e1-0e1d-4fc2-8a29-9c9199c94722 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 200 len: 345 microversion: 2.1 time: 0.058268 Jun 29 16:20:07.094366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 537/1064] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:07 2022] GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:20:08.101460 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-349bfe2b-77a3-4af4-8b02-1b95664ed416 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434ee8550>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:08.152969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-349bfe2b-77a3-4af4-8b02-1b95664ed416 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 200 len: 346 microversion: 2.1 time: 0.055781 Jun 29 16:20:08.153476 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 528/1065] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:08 2022] GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:08.164743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-90e0e8dc-9f4d-411c-9dae-b9bc92e757b5 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Action: 'create', calling method: .version_select at 0x7f0434b1f8b0>, body: {"snapshot": {"volume_id": "04a6a284-0afa-4178-9f13-30c1cfc7f54e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-320250989"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:08.307852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-90e0e8dc-9f4d-411c-9dae-b9bc92e757b5 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.147270 Jun 29 16:20:08.308540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 538/1066] 10.222.0.47 () {60 vars in 1161 bytes} [Wed Jun 29 16:20:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:08.318857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-769ed8d1-292f-4581-bb10-2697a883e6f7 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434ce8dc0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:08.347803 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-769ed8d1-292f-4581-bb10-2697a883e6f7 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.032682 Jun 29 16:20:08.348344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 529/1067] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:08 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:08.359200 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1ef4a032-3667-484c-9ec6-e45117f480bc tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434b1f1f0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:08.396512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1ef4a032-3667-484c-9ec6-e45117f480bc tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041610 Jun 29 16:20:08.397110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 539/1068] 10.222.0.47 () {58 vars in 1139 bytes} [Wed Jun 29 16:20:08 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:08.407070 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ecfeba1-1537-477c-80bc-5d0d40ba536b tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434e6bc10>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:08.436805 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ecfeba1-1537-477c-80bc-5d0d40ba536b tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.033576 Jun 29 16:20:08.437383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 530/1069] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:08 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:09.449232 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9af460ec-dd6b-4c2d-b075-f152c941a6e3 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434d915e0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:09.478061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9af460ec-dd6b-4c2d-b075-f152c941a6e3 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.033270 Jun 29 16:20:09.478604 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 540/1070] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:09 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:10.489982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bc55700-59d6-4cea-8cce-9973296c4c88 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434cae820>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:10.518878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bc55700-59d6-4cea-8cce-9973296c4c88 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.033134 Jun 29 16:20:10.519411 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 531/1071] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:10 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:11.531312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f8d592fb-618b-4ba4-bf04-8c008fcf208f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434c9b550>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:11.560860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f8d592fb-618b-4ba4-bf04-8c008fcf208f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.033342 Jun 29 16:20:11.561412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 541/1072] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:11 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:12.572229 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-53f7834a-5333-4bfa-bedb-b652e94a8569 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434d4d310>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:12.601548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-53f7834a-5333-4bfa-bedb-b652e94a8569 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.033641 Jun 29 16:20:12.602112 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 532/1073] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:12 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:13.610603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:13.614692 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a829df6a-e598-47de-a77f-12fac1a0c456 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434cfa040>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:13.644099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a829df6a-e598-47de-a77f-12fac1a0c456 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 287 microversion: 2.1 time: 0.034547 Jun 29 16:20:13.644650 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 542/1074] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:13 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:13.651651 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:13.652430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:13.657374 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dd39dd87-ab42-410f-8821-0169ab888b20 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434e4d430>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:13.719297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dd39dd87-ab42-410f-8821-0169ab888b20 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 202 len: 0 microversion: 2.1 time: 0.068434 Jun 29 16:20:13.719899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 533/1075] 10.222.0.47 () {58 vars in 1253 bytes} [Wed Jun 29 16:20:13 2022] DELETE /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:20:13.728242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d41919ed-d183-4c01-a110-64f1eeceda95 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434c90550>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:13.759554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d41919ed-d183-4c01-a110-64f1eeceda95 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 200 len: 286 microversion: 2.1 time: 0.035305 Jun 29 16:20:13.760169 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 543/1076] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:13 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:14.772283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f5b52341-078e-40f9-966a-f83a5e791334 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434d6e4c0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:14.797126 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-f5b52341-078e-40f9-966a-f83a5e791334 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] HTTP exception thrown: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f5b52341-078e-40f9-966a-f83a5e791334 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Request method failure captured: Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 HTTP/1.1 Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHu2U26slduL-HRjHO0F5R4pgrc9aqnxoyutqDkOsi3joXELoGUVc_7qBDxt4qWbT97FeuFplqHvXUZHJLCoGxynOtSxJm3bstPMiDgqHCZv0s3JtR0SSaDP6Gn-GVlgiykuB2ZvU2YLGqqJDC3WF9yKRcuwqsMDcBYDYGXMgLsuw2E Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:14.799351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ffd14b4769446d9931a7b2a987005fd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 61c73b44a46943959b8b27d259622be2 Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2'} Jun 29 16:20:14.800954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. (HTTP 404) (Request-ID: req-ec964445-9699-41e2-83b1-8c7520d89dc8) Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.801917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:14.803257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 29 16:20:14.804779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f5b52341-078e-40f9-966a-f83a5e791334 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Returning 404 to user: Snapshot 4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:14.806210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f5b52341-078e-40f9-966a-f83a5e791334 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2" status: 404 len: 111 microversion: 2.1 time: 0.032833 Jun 29 16:20:14.807259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 534/1077] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:20:14 2022] GET /compute/v2.1/os-snapshots/4f4377cf-2faa-49f3-b1c7-1e9c391a8cc2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:14.809679 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cc10af36-7453-42c4-bafb-d45322091b55 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434c7d310>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:14.869932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cc10af36-7453-42c4-bafb-d45322091b55 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 202 len: 0 microversion: 2.1 time: 0.064478 Jun 29 16:20:14.870536 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 544/1078] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:20:14 2022] DELETE /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 16:20:14.879244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f7a4ff9-7527-40a2-8902-c6359ec4b359 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434d6ee50>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:14.929761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f7a4ff9-7527-40a2-8902-c6359ec4b359 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 200 len: 345 microversion: 2.1 time: 0.054140 Jun 29 16:20:14.930314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 535/1079] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:14 2022] GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:15.943745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fdcba3a3-1ba0-403c-85ea-1ca0a0782f98 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434cfa940>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:15.971438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-fdcba3a3-1ba0-403c-85ea-1ca0a0782f98 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] HTTP exception thrown: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fdcba3a3-1ba0-403c-85ea-1ca0a0782f98 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Request method failure captured: Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e HTTP/1.1 Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHu2U26slduL-HRjHO0F5R4pgrc9aqnxoyutqDkOsi3joXELoGUVc_7qBDxt4qWbT97FeuFplqHvXUZHJLCoGxynOtSxJm3bstPMiDgqHCZv0s3JtR0SSaDP6Gn-GVlgiykuB2ZvU2YLGqqJDC3WF9yKRcuwqsMDcBYDYGXMgLsuw2E Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:15.973416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ffd14b4769446d9931a7b2a987005fd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 61c73b44a46943959b8b27d259622be2 Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '04a6a284-0afa-4178-9f13-30c1cfc7f54e'} Jun 29 16:20:15.974969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. (HTTP 404) (Request-ID: req-28be94f3-c3c0-4932-87e2-a116dff389bb) Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:15.976032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:15.977537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 16:20:15.978932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fdcba3a3-1ba0-403c-85ea-1ca0a0782f98 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Returning 404 to user: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fdcba3a3-1ba0-403c-85ea-1ca0a0782f98 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 404 len: 109 microversion: 2.1 time: 0.036031 Jun 29 16:20:15.980248 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 545/1080] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:15 2022] GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:15.986728 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88d75c7c-fca4-4255-a507-4ae42c7bac8f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434cae5e0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:16.015044 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-88d75c7c-fca4-4255-a507-4ae42c7bac8f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] HTTP exception thrown: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88d75c7c-fca4-4255-a507-4ae42c7bac8f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Request method failure captured: Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e HTTP/1.1 Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHu2U26slduL-HRjHO0F5R4pgrc9aqnxoyutqDkOsi3joXELoGUVc_7qBDxt4qWbT97FeuFplqHvXUZHJLCoGxynOtSxJm3bstPMiDgqHCZv0s3JtR0SSaDP6Gn-GVlgiykuB2ZvU2YLGqqJDC3WF9yKRcuwqsMDcBYDYGXMgLsuw2E Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:16.017087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ffd14b4769446d9931a7b2a987005fd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 61c73b44a46943959b8b27d259622be2 Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '04a6a284-0afa-4178-9f13-30c1cfc7f54e'} Jun 29 16:20:16.018632 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. (HTTP 404) (Request-ID: req-ff5013b7-e132-49d1-a2d7-f99db4717a0c) Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:16.019690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 16:20:16.021099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 16:20:16.022544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88d75c7c-fca4-4255-a507-4ae42c7bac8f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Returning 404 to user: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-88d75c7c-fca4-4255-a507-4ae42c7bac8f tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 404 len: 109 microversion: 2.1 time: 0.036519 Jun 29 16:20:16.024007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 536/1081] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:20:15 2022] DELETE /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:16.027310 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2d22ca5d-70e0-4678-9255-de56097b6803 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Calling method '.version_select at 0x7f0434c7df70>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:16.054401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-2d22ca5d-70e0-4678-9255-de56097b6803 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] HTTP exception thrown: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2d22ca5d-70e0-4678-9255-de56097b6803 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Request method failure captured: Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e HTTP/1.1 Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHu2U26slduL-HRjHO0F5R4pgrc9aqnxoyutqDkOsi3joXELoGUVc_7qBDxt4qWbT97FeuFplqHvXUZHJLCoGxynOtSxJm3bstPMiDgqHCZv0s3JtR0SSaDP6Gn-GVlgiykuB2ZvU2YLGqqJDC3WF9yKRcuwqsMDcBYDYGXMgLsuw2E Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:16.056482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ffd14b4769446d9931a7b2a987005fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ffd14b4769446d9931a7b2a987005fd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 7ffd14b4769446d9931a7b2a987005fd Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-821356350 Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 61c73b44a46943959b8b27d259622be2 Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-821356350-project Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '04a6a284-0afa-4178-9f13-30c1cfc7f54e'} Jun 29 16:20:16.058043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. (HTTP 404) (Request-ID: req-bddbc927-1825-403a-81f9-fb9fed554994) Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:16.058882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:16.060383 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 16:20:16.062349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2d22ca5d-70e0-4678-9255-de56097b6803 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] Returning 404 to user: Volume 04a6a284-0afa-4178-9f13-30c1cfc7f54e could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2d22ca5d-70e0-4678-9255-de56097b6803 tempest-VolumesSnapshotsTestJSON-821356350 tempest-VolumesSnapshotsTestJSON-821356350-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e" status: 404 len: 109 microversion: 2.1 time: 0.034294 Jun 29 16:20:16.063710 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 546/1082] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:16 2022] GET /compute/v2.1/os-volumes/04a6a284-0afa-4178-9f13-30c1cfc7f54e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:17.397014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a6252daa-d064-4ea7-a186-73f677be0a1f tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Action: 'create', calling method: .version_select at 0x7f0434e3b040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-586949416", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:17.677951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a6252daa-d064-4ea7-a186-73f677be0a1f tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.392632 Jun 29 16:20:17.678566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 537/1083] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Jun 29 16:20:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 394 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 16:20:17.686836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:17.691096 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ecdf350c-5d95-4115-a5ef-ab32b75b73e9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Calling method '.version_select at 0x7f0434c7d430>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:17.748304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ecdf350c-5d95-4115-a5ef-ab32b75b73e9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d" status: 200 len: 352 microversion: 2.1 time: 0.062646 Jun 29 16:20:17.751885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 547/1084] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:17 2022] GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:18.761189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34fae1bc-2679-449d-8d4e-17b3bda35bda tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Calling method '.version_select at 0x7f0434ce8790>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:18.807189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34fae1bc-2679-449d-8d4e-17b3bda35bda tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d" status: 200 len: 353 microversion: 2.1 time: 0.050271 Jun 29 16:20:18.807736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 538/1085] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:18 2022] GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:18.819063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0603854f-7c9b-4752-97a2-63ffdb53b081 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Calling method '.version_select at 0x7f0434ccadc0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:18.865339 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0603854f-7c9b-4752-97a2-63ffdb53b081 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d" status: 200 len: 353 microversion: 2.1 time: 0.050406 Jun 29 16:20:18.865911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 548/1086] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:18 2022] GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:18.881385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0491d271-a579-4d8c-ac69-ec44986796da tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Calling method '.version_select at 0x7f0434eb4820>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:18.940907 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0491d271-a579-4d8c-ac69-ec44986796da tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d" status: 202 len: 0 microversion: 2.1 time: 0.063179 Jun 29 16:20:18.941468 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 539/1087] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:20:18 2022] DELETE /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:20:18.949283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-440ab52b-6aef-4dca-bc30-243866be0249 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Calling method '.version_select at 0x7f0434b1fdc0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:18.996155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-440ab52b-6aef-4dca-bc30-243866be0249 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d" status: 200 len: 352 microversion: 2.1 time: 0.050562 Jun 29 16:20:18.996729 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 549/1088] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:18 2022] GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:20.008984 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-027fb173-9d63-4be3-a0ab-39580290d2d9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Calling method '.version_select at 0x7f0434e295e0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:20.036769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-027fb173-9d63-4be3-a0ab-39580290d2d9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] HTTP exception thrown: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-027fb173-9d63-4be3-a0ab-39580290d2d9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Request method failure captured: Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d HTTP/1.1 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHvB2u9oLEXzGwBFxEQg3Ld_g5wqUfQfCYnv-v6VgLRWRNXuZMb1PeDuWawiwLmY9igvUpwAh1ltkAQvEyAFQfwEiP2ijCSQod7MhFSEMEiNGY158dp1flvazL_4IwNKXA4C8ByESgZ22XSsQY2ax8t4VX955lexG9hNDJO21nGN144 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: afda5c366590493fa517b5d624718190 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesGetTestJSON-509306228 Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:20.038730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/afda5c366590493fa517b5d624718190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/afda5c366590493fa517b5d624718190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/afda5c366590493fa517b5d624718190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_afda5c366590493fa517b5d624718190", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesGetTestJSON-509306228 Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: afda5c366590493fa517b5d624718190 Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesGetTestJSON-509306228 Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesGetTestJSON-509306228-project Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 14252bab9afe4dd5bc22e7f69fe9a54b Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesGetTestJSON-509306228-project Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '8e4912e8-8159-4642-bc78-4d3835e53c8d'} Jun 29 16:20:20.040311 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. (HTTP 404) (Request-ID: req-fdf561b8-0071-4d37-b882-f0e547570a7d) Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:20.041251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 16:20:20.042449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 16:20:20.043618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-027fb173-9d63-4be3-a0ab-39580290d2d9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] Returning 404 to user: Volume 8e4912e8-8159-4642-bc78-4d3835e53c8d could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-027fb173-9d63-4be3-a0ab-39580290d2d9 tempest-VolumesGetTestJSON-509306228 tempest-VolumesGetTestJSON-509306228-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d" status: 404 len: 109 microversion: 2.1 time: 0.035483 Jun 29 16:20:20.045446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 540/1089] 10.222.0.47 () {58 vars in 1244 bytes} [Wed Jun 29 16:20:20 2022] GET /compute/v2.1/os-volumes/8e4912e8-8159-4642-bc78-4d3835e53c8d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:30.313941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:30.314515 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:30.320559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:30.320995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:30.321736 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:30.322162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:30.346755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ca49cf3f-73fb-4b0d-827c-eb948b3612fd tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/ips" status: 200 len: 149 microversion: 2.1 time: 0.038057 Jun 29 16:20:30.347235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 550/1090] 10.222.0.47 () {58 vars in 1247 bytes} [Wed Jun 29 16:20:30 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:31.669211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "514f6de1-ddbf-473a-b0f4-86dc183b0a13"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:31.670853 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:31.677169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:31.677614 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:31.678366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:31.678794 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:31.945552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a0cb9a3-687e-4293-b0d6-03ab56592432 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "POST /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280849 Jun 29 16:20:31.946165 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 541/1091] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:20:31 2022] POST /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:39.532109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:39.532623 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:39.539194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:39.539639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:39.540422 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:39.540852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:39.618825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lazy-loading 'services' on Instance uuid 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:20:39.690083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ce6c5321-4605-42f2-a089-a9e5e6fa688e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments/514f6de1-ddbf-473a-b0f4-86dc183b0a13" status: 202 len: 0 microversion: 2.1 time: 0.161657 Jun 29 16:20:39.690617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 551/1092] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:20:39 2022] DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments/514f6de1-ddbf-473a-b0f4-86dc183b0a13 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:20:39.699857 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:39.700867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:39.708087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:39.708455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:39.709200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:39.709637 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:39.741902 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03d4e382-1e14-4afe-99a0-3bca47e7870d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046735 Jun 29 16:20:39.745745 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 542/1093] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:20:39 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:40.755244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:40.756351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:40.762656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:40.763105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:40.763880 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:40.764321 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:40.793118 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e7abce26-45a2-4ad3-8427-754658870d0e tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043364 Jun 29 16:20:40.793695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 552/1094] 10.222.0.47 () {58 vars in 1301 bytes} [Wed Jun 29 16:20:40 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 16:20:40.851612 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:40.853466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:40.865897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:40.866336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:40.867123 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:40.867890 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:40.902788 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:20:40.977464 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4509d2e3-d7bd-4ea8-b38b-3d27c6c460bf tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 204 len: 0 microversion: 2.1 time: 0.129573 Jun 29 16:20:40.978048 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 543/1095] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:40 2022] DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:20:40.987056 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:40.987657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:40.993766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:40.994202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:40.994944 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:40.995369 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:41.122702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:41.134224 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2e83a765-b24a-45d1-b5e0-74b0f3094a07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1681 microversion: 2.1 time: 0.151656 Jun 29 16:20:41.134804 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 553/1096] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:40 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:42.152313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:42.152946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:42.159509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:42.159995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:42.160752 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:42.161187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:42.295159 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:42.303043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-09bd0096-17ab-48e6-bdd2-51d3ea104c07 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1681 microversion: 2.1 time: 0.155026 Jun 29 16:20:42.303615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 544/1097] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:42 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:43.320859 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:43.321471 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:43.328234 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:43.328886 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:43.329650 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:43.330081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:43.460486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:43.467917 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-653dfec5-80d5-47f9-8846-3b1812e7835a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1681 microversion: 2.1 time: 0.151003 Jun 29 16:20:43.469226 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 554/1098] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:43 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:43.990259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-506c34ef-ef96-46d3-8cc1-c4db92d657f0 req-659f0f8e-64db-4a6b-876a-79e7b3c48c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a97b17d-a69e-4288-8f3c-fbd790f8cce5", "name": "network-vif-deleted", "tag": "17e4d95f-713e-4003-9049-864c767c744c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:44.003211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-506c34ef-ef96-46d3-8cc1-c4db92d657f0 req-659f0f8e-64db-4a6b-876a-79e7b3c48c1f service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:44.003663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-506c34ef-ef96-46d3-8cc1-c4db92d657f0 req-659f0f8e-64db-4a6b-876a-79e7b3c48c1f service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:44.017130 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-506c34ef-ef96-46d3-8cc1-c4db92d657f0 req-659f0f8e-64db-4a6b-876a-79e7b3c48c1f service nova] Creating event network-vif-deleted:17e4d95f-713e-4003-9049-864c767c744c for instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 on hv-cinder-84814 Jun 29 16:20:44.022195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-506c34ef-ef96-46d3-8cc1-c4db92d657f0 req-659f0f8e-64db-4a6b-876a-79e7b3c48c1f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Jun 29 16:20:44.022810 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 545/1099] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:44.486377 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:44.487107 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:44.493755 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:44.494205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:44.494967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:44.495403 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:44.565769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:44.573416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c519f26f-6d07-42f6-99b3-fcc9b347cfda tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1613 microversion: 2.1 time: 0.091429 Jun 29 16:20:44.573974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 555/1100] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:44 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:45.590970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:45.591665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:45.598811 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:45.599251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:45.600030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:45.600458 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:45.916690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:45.924398 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-28d7ef37-281a-4e32-8b6c-241eb392fdc6 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1326 microversion: 2.1 time: 0.337557 Jun 29 16:20:45.924963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 546/1101] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:45 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1326 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:46.942445 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:46.943053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:46.949632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:46.950071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:46.950818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:46.951242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:47.011400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020c486ef3e4fceb1d671269668ba68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:47.019316 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-798e99d7-77c4-474c-9e01-56be1594fbea tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 200 len: 1326 microversion: 2.1 time: 0.080949 Jun 29 16:20:47.019910 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 556/1102] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:46 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 1326 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:47.689503 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:47.690428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:47.696931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:47.697381 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:47.698135 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:47.698566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:47.732307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4fb62681-985b-49d5-9f41-83c074773186 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047151 Jun 29 16:20:47.733190 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 547/1103] 10.222.0.47 () {60 vars in 1342 bytes} [Wed Jun 29 16:20:47 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:47.790960 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:47.791542 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:47.797668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:47.798113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:47.798873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:47.799301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:47.825864 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:20:47.900450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-233ed78b-9e22-4820-b0ef-7dd30f465e28 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 204 len: 0 microversion: 2.20 time: 0.113095 Jun 29 16:20:47.901025 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 557/1104] 10.222.0.47 () {60 vars in 1279 bytes} [Wed Jun 29 16:20:47 2022] DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 16:20:47.909095 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:47.909703 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:47.916091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:47.916538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:47.917317 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:47.917731 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:48.037011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:48.037719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:48.044684 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:48.045138 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:48.045909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:48.046889 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:48.049842 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:48.057734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:48.059252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:48.060438 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d9acb99-134b-4f07-80ea-57bc662d7fd6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.155233 Jun 29 16:20:48.061200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 548/1105] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:47 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:48.061341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 HTTP/1.1 Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:48.063405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:48.065155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '7a97b17d-a69e-4288-8f3c-fbd790f8cce5'} Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:48.066398 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:48.067981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:48.070613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:48.070613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e4fdf5a2-a1ed-43cc-95e8-f20a768f3e0a tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 404 len: 111 microversion: 2.1 time: 0.032053 Jun 29 16:20:48.070613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 558/1106] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:48 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 16:20:48.073336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e306223d-f21f-4c2a-b0cb-a96a4b33e6b2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '.version_select at 0x7f04395bbee0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:48.090584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e306223d-f21f-4c2a-b0cb-a96a4b33e6b2 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648369276" status: 202 len: 0 microversion: 2.1 time: 0.020864 Jun 29 16:20:48.091148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 549/1107] 10.222.0.47 () {58 vars in 1217 bytes} [Wed Jun 29 16:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648369276 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 16:20:49.079345 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:49.079934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:49.086548 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:49.086998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:49.087762 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:49.088529 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:49.216995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:49.225362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:49.226875 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:49.228060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b9c60754-d876-4d29-b829-e3cb2d2849ef tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.152798 Jun 29 16:20:49.228617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 559/1108] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:49 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:50.246873 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:50.247473 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:50.253492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:50.253933 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:50.254681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:50.255203 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:50.381366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:50.389150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:50.391423 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:50.392590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e9b8515-9af6-42d4-850c-24cbffaacc73 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.150218 Jun 29 16:20:50.393134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 550/1109] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:50 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:51.411227 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:51.411758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:51.418426 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:51.418867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:51.419612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:51.420079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:51.544486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:51.552449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:51.554044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:51.555198 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ad8d6b71-8868-4638-8b97-df7624c24119 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.148028 Jun 29 16:20:51.555753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 560/1110] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:51 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:52.574591 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:52.575161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:52.581809 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.582253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.583002 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.583433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.712368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:52.721307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:52.723014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:52.724407 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-70d7bf30-877d-4ff4-917c-06ebd9015c90 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.153816 Jun 29 16:20:52.725257 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 551/1111] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:52 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:52.750827 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:52.751424 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:52.757549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.757998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.758754 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.759182 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.784222 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:20:52.868820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-16ca4fc3-6a0e-4dc8-ab83-e96d7cf40e34 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "DELETE /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 204 len: 0 microversion: 2.1 time: 0.122121 Jun 29 16:20:52.869503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 561/1112] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:52 2022] DELETE /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:20:52.877434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:52.878043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:52.884017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.884460 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.885211 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.885639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.948159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:52.949205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:52.961820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.962270 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.963036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.963498 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.978058 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 HTTP/1.1 Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:52.979702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:52.981454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '7a97b17d-a69e-4288-8f3c-fbd790f8cce5'} Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:52.982549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:52.984137 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:52.986298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:52.986298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-329bde95-4922-4c14-a4fd-b0dd7a136c08 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 404 len: 111 microversion: 2.1 time: 0.037219 Jun 29 16:20:52.986298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 562/1113] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:52 2022] DELETE /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 16:20:52.990121 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:52.990723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 7a97b17d-a69e-4288-8f3c-fbd790f8cce5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:52.996731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.997177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:52.997929 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:52.998359 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:53.011799 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 HTTP/1.1 Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:53.013352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:53.015010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '7a97b17d-a69e-4288-8f3c-fbd790f8cce5'} Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:53.015806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. Jun 29 16:20:53.017057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:53.018149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 7a97b17d-a69e-4288-8f3c-fbd790f8cce5 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:53.018149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-aed127c1-334a-426c-860d-4b3d5f50fec0 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5" status: 404 len: 111 microversion: 2.1 time: 0.028421 Jun 29 16:20:53.019921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 563/1114] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:52 2022] GET /compute/v2.1/servers/7a97b17d-a69e-4288-8f3c-fbd790f8cce5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:53.050774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:53.059663 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-007c5b93-7151-4ac0-b6b4-589db5f26aac tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1577 microversion: 2.1 time: 0.185906 Jun 29 16:20:53.070113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 552/1115] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:52 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:53.742598 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:53.743209 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:53.749409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:53.749860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:53.751281 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:53.751857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:53.887451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:53.891435 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:53.896774 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:53.898252 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:53.899389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-066dadbf-6065-48cc-9eb6-7b8d4e883646 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1725 microversion: 2.20 time: 0.160741 Jun 29 16:20:53.899959 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 564/1116] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:53 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:54.077058 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:54.077662 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:54.084409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.084872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.085617 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.086085 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.162682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:54.163267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:54.170696 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.171155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.172083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.173152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.188298 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 HTTP/1.1 Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:54.190108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.192111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '24be8382-229e-4cea-8504-fa5b22a825a5'} Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:54.192847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.194294 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.196815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:54.196815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c179a855-8a7e-4a0b-b093-2e53d2109f13 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 404 len: 111 microversion: 2.1 time: 0.034534 Jun 29 16:20:54.196815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 565/1117] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:54 2022] DELETE /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:54.201938 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:54.202623 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 24be8382-229e-4cea-8504-fa5b22a825a5] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:54.209608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.210197 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.211175 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.211885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.229235 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 HTTP/1.1 Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:54.230899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.232516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '24be8382-229e-4cea-8504-fa5b22a825a5'} Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:54.233382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. Jun 29 16:20:54.235432 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.236758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 24be8382-229e-4cea-8504-fa5b22a825a5 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:54.236758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7669697f-dabb-470c-805a-949783f4388f tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5" status: 404 len: 111 microversion: 2.1 time: 0.035042 Jun 29 16:20:54.236758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 566/1118] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:54 2022] GET /compute/v2.1/servers/24be8382-229e-4cea-8504-fa5b22a825a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:54.242649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:54.247539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:54.248113 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:54.250396 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc159947-1ca4-4d76-aa60-d943b642f5e7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1577 microversion: 2.1 time: 0.177110 Jun 29 16:20:54.251296 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 553/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:54 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:54.255240 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.255733 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.256475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.256908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.270818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de HTTP/1.1 Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:54.272393 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.273748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': 'cb19a48e-3146-4a11-9534-d8ccf44270de'} Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:54.274543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.276275 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.278009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:54.278009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-685ae066-163d-4402-a557-5458189a1c06 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 404 len: 111 microversion: 2.1 time: 0.034368 Jun 29 16:20:54.278009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 567/1120] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:54 2022] DELETE /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:54.284894 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:54.285709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: cb19a48e-3146-4a11-9534-d8ccf44270de] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:54.292307 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.292964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.293724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.294319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.313667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de HTTP/1.1 Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:54.316849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.318441 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': 'cb19a48e-3146-4a11-9534-d8ccf44270de'} Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:54.319262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. Jun 29 16:20:54.320655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:54.321886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance cb19a48e-3146-4a11-9534-d8ccf44270de could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:54.321886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0980aa6c-eb13-496c-831c-ba10c9a7076d tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de" status: 404 len: 111 microversion: 2.1 time: 0.038329 Jun 29 16:20:54.321886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 554/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:54 2022] GET /compute/v2.1/servers/cb19a48e-3146-4a11-9534-d8ccf44270de => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:54.917721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:54.918404 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:54.926186 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.926636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.927587 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:54.928061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:54.996008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:55.004804 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:55.006541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:55.007809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1cf22dba-aaee-4c88-869d-10a65027e4de tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1657 microversion: 2.20 time: 0.094362 Jun 29 16:20:55.008646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 568/1122] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:54 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:55.266765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:55.267654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:55.285483 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.287149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.292266 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.294851 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.503084 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-9f3f3bb1-244e-4dfb-9a3a-37d4c4b4ed79 req-5bd3d6cc-f841-4ccb-ad05-f563b26650d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd9fd0f-e713-42ac-95a5-271fa28b19dc", "name": "network-vif-deleted", "tag": "78edfeea-e37a-4e66-939f-4957f4fbb8d3"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:55.520139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:55.535684 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0d36fe96-f2f7-437b-a462-b1422fa94add tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1577 microversion: 2.1 time: 0.273052 Jun 29 16:20:55.542684 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 569/1123] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:55 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:20:55.548881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:55.549453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:55.551532 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-9f3f3bb1-244e-4dfb-9a3a-37d4c4b4ed79 req-5bd3d6cc-f841-4ccb-ad05-f563b26650d1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.552383 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-9f3f3bb1-244e-4dfb-9a3a-37d4c4b4ed79 req-5bd3d6cc-f841-4ccb-ad05-f563b26650d1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.570234 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-9f3f3bb1-244e-4dfb-9a3a-37d4c4b4ed79 req-5bd3d6cc-f841-4ccb-ad05-f563b26650d1 service nova] Creating event network-vif-deleted:78edfeea-e37a-4e66-939f-4957f4fbb8d3 for instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc on hv-cinder-84814 Jun 29 16:20:55.572031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.572723 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.575324 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.575886 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.577516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-9f3f3bb1-244e-4dfb-9a3a-37d4c4b4ed79 req-5bd3d6cc-f841-4ccb-ad05-f563b26650d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381088 Jun 29 16:20:55.579388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 555/1124] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:20:55.612816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.613277 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8dcbcfcc-946e-4b64-8982-012d9f787e44 req-45b89974-a754-42b2-b596-9d35b4dbb2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd", "name": "network-vif-unplugged", "status": "completed", "tag": "3d9e16e1-9be2-44af-9608-e0db3a027bcf"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd HTTP/1.1 Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:55.614656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.616353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '5c170b82-196f-4eb1-aee4-915ea0fdbffd'} Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:55.620948 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.622153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.623391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:55.623391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-044118cd-298d-4f3d-9905-5ffa5bb85878 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 404 len: 111 microversion: 2.1 time: 0.073913 Jun 29 16:20:55.628346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 570/1125] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:20:55 2022] DELETE /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:55.643115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8dcbcfcc-946e-4b64-8982-012d9f787e44 req-45b89974-a754-42b2-b596-9d35b4dbb2f5 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.643792 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8dcbcfcc-946e-4b64-8982-012d9f787e44 req-45b89974-a754-42b2-b596-9d35b4dbb2f5 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.645803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:55.649315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] [instance: 5c170b82-196f-4eb1-aee4-915ea0fdbffd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:55.666820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.667581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.671195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:55.673465 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:55.679555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8dcbcfcc-946e-4b64-8982-012d9f787e44 req-45b89974-a754-42b2-b596-9d35b4dbb2f5 service nova] Creating event network-vif-unplugged:3d9e16e1-9be2-44af-9608-e0db3a027bcf for instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd on hv-cinder-84814 Jun 29 16:20:55.686941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8dcbcfcc-946e-4b64-8982-012d9f787e44 req-45b89974-a754-42b2-b596-9d35b4dbb2f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080764 Jun 29 16:20:55.687555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 556/1126] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:55.698026 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] HTTP exception thrown: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Request method failure captured: Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd HTTP/1.1 Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlayZT-cwavqdZI5aGkaU-xPkKRACwwe9Ejh2rcoNBQiKtCoUb9xR92plDDrJ8Q--ZCYBFSprxu9Df0kWQwe8c03PGcWmTaHq4Qtiye-O8FU_ZnOxdnN5Zemr-QcSx1xz-6IJi3np6Q7HFHoq6N3JCCjUY-TYscHd4W1I943wVmOPE Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:55.699765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f81b8fe398ae4ed19d6b9f49f6490e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f81b8fe398ae4ed19d6b9f49f6490e5a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: f81b8fe398ae4ed19d6b9f49f6490e5a Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2067932430 Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 2020c486ef3e4fceb1d671269668ba68 Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeNegativeTest-2067932430-project Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.701379 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '5c170b82-196f-4eb1-aee4-915ea0fdbffd'} Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:55.702453 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. Jun 29 16:20:55.704049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:55.706698 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] Returning 404 to user: Instance 5c170b82-196f-4eb1-aee4-915ea0fdbffd could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:55.708061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fa60383c-c31d-4257-9498-54a9a030d100 tempest-AttachVolumeNegativeTest-2067932430 tempest-AttachVolumeNegativeTest-2067932430-project] 10.222.0.47 "GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd" status: 404 len: 111 microversion: 2.1 time: 0.073099 Jun 29 16:20:55.709021 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 571/1127] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:55 2022] GET /compute/v2.1/servers/5c170b82-196f-4eb1-aee4-915ea0fdbffd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:56.029615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:56.033177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:56.040247 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:56.040993 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:56.041917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:56.042502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:56.092004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:56.092639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:56.093714 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lazy-loading 'fault' on Instance uuid 3dd9fd0f-e713-42ac-95a5-271fa28b19dc {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:20:56.155495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:56.162015 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:56.176900 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:56.179047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75d976f2c554209bc4c64d338ad7cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3910745b858045628982687e473c23b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:56.180664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cf9fbcd3-d9b7-492e-8048-3183500426b8 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 200 len: 1371 microversion: 2.20 time: 0.156828 Jun 29 16:20:56.181890 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 557/1128] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:56 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 16:20:56.557834 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:56.559048 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:56.566997 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:56.567751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:56.568786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:56.569386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:56.842832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:56.850780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-75bd6353-508e-417a-b368-9100c6a613d1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 200 len: 1226 microversion: 2.1 time: 0.296925 Jun 29 16:20:56.856225 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 572/1129] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:56 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 1226 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:57.200125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:57.200802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:57.209646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:57.210188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:57.211133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:57.211872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:57.240649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] HTTP exception thrown: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Request method failure captured: Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc HTTP/1.1 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlTfUAp6T8VpDotnI7_HkuMq8qO6dqylAKmY2As-JL6p_f-0zdR1gLLHggWun0V0CGn5YMVljRFzhkPrFofW8Myjia3Qj3k_TdK-wZkbgUc3KdixUwtTRUSgooDk8rNm7dey6Gqfin-9am75zpSHR5Kiz3SB7OmvXJAbS1pE5g8MSY Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3910745b858045628982687e473c23b7 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:57.242523 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3910745b858045628982687e473c23b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3910745b858045628982687e473c23b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3910745b858045628982687e473c23b7 Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: d75d976f2c554209bc4c64d338ad7cf7 Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:57.244402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '3dd9fd0f-e713-42ac-95a5-271fa28b19dc'} Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:57.245352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:57.247210 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.248961 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Returning 404 to user: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:57.252913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c0c1d68a-4ac0-426c-92ae-a744aef286d7 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 404 len: 111 microversion: 2.20 time: 0.057413 Jun 29 16:20:57.253567 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 558/1130] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:57 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:20:57.262779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-89a5c558-f413-426a-9b0a-bcec830c7eb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '.version_select at 0x7f04362f59d0>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:57.286000 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-89a5c558-f413-426a-9b0a-bcec830c7eb6 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179106913" status: 204 len: 0 microversion: 2.20 time: 0.027176 Jun 29 16:20:57.286366 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 573/1131] 10.222.0.47 () {60 vars in 1261 bytes} [Wed Jun 29 16:20:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179106913 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 16:20:57.650544 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8810672e-2f12-4648-bb7c-3127f1862def req-824dd7b5-5d68-4ea0-a844-ca796c825820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd", "name": "network-vif-deleted", "tag": "3d9e16e1-9be2-44af-9608-e0db3a027bcf"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:57.668178 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8810672e-2f12-4648-bb7c-3127f1862def req-824dd7b5-5d68-4ea0-a844-ca796c825820 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:57.668619 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8810672e-2f12-4648-bb7c-3127f1862def req-824dd7b5-5d68-4ea0-a844-ca796c825820 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:57.685694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8810672e-2f12-4648-bb7c-3127f1862def req-824dd7b5-5d68-4ea0-a844-ca796c825820 service nova] Creating event network-vif-deleted:3d9e16e1-9be2-44af-9608-e0db3a027bcf for instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd on hv-cinder-84814 Jun 29 16:20:57.691188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8810672e-2f12-4648-bb7c-3127f1862def req-824dd7b5-5d68-4ea0-a844-ca796c825820 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049774 Jun 29 16:20:57.692063 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 559/1132] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:20:57.868535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:57.869212 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:57.875891 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:57.876474 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:57.877246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:57.877689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:57.892522 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] HTTP exception thrown: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Request method failure captured: Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd HTTP/1.1 Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHsV1QD_YkCp6PFLB91BQMqAg8JJsm7wCCOSoNCnNxnTGebyqKYF3b7uzayZcqc2D5XTAbVufU9_wvKucFNxZEsljmfWDadYOmS8n21bVXa8X6-mz4cu9X_T3vu-YO3Q8ZvNcSJ0RX0F2LFGKifh6iW7HkQhX0D_ObC6xEDS5sWN-js Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:57.894071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c561382be984c2b9c1285c6e5b6268a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: da01cd253f6e4bc792868f337ff85b0a Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:20:57.895503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd'} Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:57.896484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:20:57.897871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:57.899063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Returning 404 to user: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:57.899063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d8599a41-6a1b-4685-a95a-6bd88a2abbf1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 404 len: 111 microversion: 2.1 time: 0.031404 Jun 29 16:20:57.899063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 574/1133] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:57 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:20:57.994535 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1002903155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1528332792", "security_groups": [{"name": "tempest-secgroup-smoke-1095340995"}], "block_device_mapping_v2": [{"uuid": "5e33aeda-2b91-4f4a-b091-95f462be6953", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1a48c25-8bb7-4e07-98a2-dce74f3bae14"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:20:58.126723 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] validate_networks() for [('b1a48c25-8bb7-4e07-98a2-dce74f3bae14', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:20:58.574918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:20:58.575587 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:20:58.575719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:20:58.576388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:20:58.576965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:20:58.591724 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:58.595770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:58.596853 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:58.597571 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:58.626067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:20:58.632642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for user da01cd253f6e4bc792868f337ff85b0a and project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:20:58.757564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:20:58.760144 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e33aeda-2b91-4f4a-b091-95f462be6953',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:20:58.925382 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-516b714f-8f97-4994-b802-54f14084f282 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.935186 Jun 29 16:20:58.926812 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 560/1134] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:20:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:20:58.938503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-aa9ecb6a-cfa7-4aa9-809d-73437f6218f5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:58.939183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-aa9ecb6a-cfa7-4aa9-809d-73437f6218f5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:59.040672 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-aa9ecb6a-cfa7-4aa9-809d-73437f6218f5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:20:59.049635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-aa9ecb6a-cfa7-4aa9-809d-73437f6218f5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1095 microversion: 2.1 time: 0.116453 Jun 29 16:20:59.051869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 575/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:20:58 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1095 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:20:59.730157 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:59.730937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:59.742290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:59.742737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:59.743507 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:59.743975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:59.758758 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] HTTP exception thrown: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Request method failure captured: Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc HTTP/1.1 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlTfUAp6T8VpDotnI7_HkuMq8qO6dqylAKmY2As-JL6p_f-0zdR1gLLHggWun0V0CGn5YMVljRFzhkPrFofW8Myjia3Qj3k_TdK-wZkbgUc3KdixUwtTRUSgooDk8rNm7dey6Gqfin-9am75zpSHR5Kiz3SB7OmvXJAbS1pE5g8MSY Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3910745b858045628982687e473c23b7 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:20:59.760524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3910745b858045628982687e473c23b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3910745b858045628982687e473c23b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3910745b858045628982687e473c23b7 Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: d75d976f2c554209bc4c64d338ad7cf7 Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.762174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '3dd9fd0f-e713-42ac-95a5-271fa28b19dc'} Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:59.762925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.764158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.765679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Returning 404 to user: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:59.765679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6ee7dbb1-23df-4f2f-8afd-651a7e7e5e06 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 404 len: 111 microversion: 2.20 time: 0.036377 Jun 29 16:20:59.765679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 561/1136] 10.222.0.47 () {60 vars in 1279 bytes} [Wed Jun 29 16:20:59 2022] DELETE /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:20:59.771420 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:20:59.772312 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 3dd9fd0f-e713-42ac-95a5-271fa28b19dc] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:20:59.783207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:59.783207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:59.783207 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:20:59.783909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:20:59.799002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] HTTP exception thrown: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Request method failure captured: Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc HTTP/1.1 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlTfUAp6T8VpDotnI7_HkuMq8qO6dqylAKmY2As-JL6p_f-0zdR1gLLHggWun0V0CGn5YMVljRFzhkPrFofW8Myjia3Qj3k_TdK-wZkbgUc3KdixUwtTRUSgooDk8rNm7dey6Gqfin-9am75zpSHR5Kiz3SB7OmvXJAbS1pE5g8MSY Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 3910745b858045628982687e473c23b7 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:20:59.800764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3910745b858045628982687e473c23b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3910745b858045628982687e473c23b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 3910745b858045628982687e473c23b7 Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: d75d976f2c554209bc4c64d338ad7cf7 Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.802237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '3dd9fd0f-e713-42ac-95a5-271fa28b19dc'} Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:20:59.803102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. Jun 29 16:20:59.804626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:20:59.806123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Returning 404 to user: Instance 3dd9fd0f-e713-42ac-95a5-271fa28b19dc could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:20:59.806123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-260f6173-c00f-4d4a-b91e-7456ebddbfd3 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc" status: 404 len: 111 microversion: 2.20 time: 0.034541 Jun 29 16:20:59.806123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 576/1137] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:20:59 2022] GET /compute/v2.1/servers/3dd9fd0f-e713-42ac-95a5-271fa28b19dc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:21:00.066832 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:00.067692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:00.075657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:00.076277 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:00.077056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:00.077648 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:00.146691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:00.154104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-355bd61c-47bf-4867-9fc3-7714783442fe tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1145 microversion: 2.1 time: 0.091684 Jun 29 16:21:00.154778 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 562/1138] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:00 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:01.171585 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:01.172931 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:01.175182 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:01.180818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:01.181301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:01.182009 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:01.182431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:01.250413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:01.264882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2cd2df35-e3ba-44f0-9c26-d38ee0663a81 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1137 microversion: 2.1 time: 0.093747 Jun 29 16:21:01.265876 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 577/1139] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:01 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1137 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:02.282112 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:02.282718 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:02.285150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:02.290385 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:02.290815 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:02.291556 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:02.292014 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:02.353719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:02.361572 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-85db35c3-c26c-4c14-bf22-5ac16c8582c8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1137 microversion: 2.1 time: 0.083425 Jun 29 16:21:02.362121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 563/1140] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:02 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:03.378881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:03.379613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:03.386394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:03.387099 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:03.387972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:03.388482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:03.454583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:03.461986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-29bc7fd0-3580-4abf-84df-eb29619e3998 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1201 microversion: 2.1 time: 0.087521 Jun 29 16:21:03.462600 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 578/1141] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:03 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:04.131300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:04.132885 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:04.141415 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:04.142218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:04.143866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:04.143866 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:04.161530 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] HTTP exception thrown: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Request method failure captured: Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe HTTP/1.1 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHlTfUAp6T8VpDotnI7_HkuMq8qO6dqylAKmY2As-JL6p_f-0zdR1gLLHggWun0V0CGn5YMVljRFzhkPrFofW8Myjia3Qj3k_TdK-wZkbgUc3KdixUwtTRUSgooDk8rNm7dey6Gqfin-9am75zpSHR5Kiz3SB7OmvXJAbS1pE5g8MSY Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 3910745b858045628982687e473c23b7 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:21:04.163751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3910745b858045628982687e473c23b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3910745b858045628982687e473c23b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 3910745b858045628982687e473c23b7 Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: d75d976f2c554209bc4c64d338ad7cf7 Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.165461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '7c8c3aca-bf52-4212-9953-29cdfc5cc8fe'} Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:21:04.166380 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.167990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.171464 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Returning 404 to user: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:21:04.174982 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bf443e08-2cab-4a2e-9076-58d7948057ff tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 404 len: 111 microversion: 2.20 time: 0.049620 Jun 29 16:21:04.176505 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 564/1142] 10.222.0.47 () {60 vars in 1279 bytes} [Wed Jun 29 16:21:04 2022] DELETE /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:21:04.187285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:04.187957 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] [instance: 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:04.194353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:04.194804 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:04.195594 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:04.196054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:04.215273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] HTTP exception thrown: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Request method failure captured: Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe HTTP/1.1 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHlTfUAp6T8VpDotnI7_HkuMq8qO6dqylAKmY2As-JL6p_f-0zdR1gLLHggWun0V0CGn5YMVljRFzhkPrFofW8Myjia3Qj3k_TdK-wZkbgUc3KdixUwtTRUSgooDk8rNm7dey6Gqfin-9am75zpSHR5Kiz3SB7OmvXJAbS1pE5g8MSY Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 3910745b858045628982687e473c23b7 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:21:04.217401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3910745b858045628982687e473c23b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3910745b858045628982687e473c23b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3910745b858045628982687e473c23b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 3910745b858045628982687e473c23b7 Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512342876 Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: d75d976f2c554209bc4c64d338ad7cf7 Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512342876-project Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.219554 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '7c8c3aca-bf52-4212-9953-29cdfc5cc8fe'} Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:21:04.220328 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. Jun 29 16:21:04.221572 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:04.224061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] Returning 404 to user: Instance 7c8c3aca-bf52-4212-9953-29cdfc5cc8fe could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:21:04.225230 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-20200dd4-9e39-4f34-a395-f7a391c06138 tempest-AttachVolumeShelveTestJSON-1512342876 tempest-AttachVolumeShelveTestJSON-1512342876-project] 10.222.0.47 "GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe" status: 404 len: 111 microversion: 2.20 time: 0.043377 Jun 29 16:21:04.226287 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 579/1143] 10.222.0.47 () {60 vars in 1276 bytes} [Wed Jun 29 16:21:04 2022] GET /compute/v2.1/servers/7c8c3aca-bf52-4212-9953-29cdfc5cc8fe => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 16:21:04.483564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:04.484241 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:04.497519 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:04.499551 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:04.501659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:04.502320 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:05.078839 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:05.086925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-930de84a-3045-478a-94aa-734ac53f5bc5 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1279 microversion: 2.1 time: 0.610547 Jun 29 16:21:05.087496 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 565/1144] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:04 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1279 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:05.772518 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-7f7f8d1d-6c58-494b-88eb-8712db09bf21 req-2fd31a82-57c6-46fc-b321-1827ecc0eb92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5617b152-0a28-4c51-98ac-11a45008d37f", "tag": "f5672af0-3e3f-4d09-9fb4-77322e497ab8"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:05.790155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-7f7f8d1d-6c58-494b-88eb-8712db09bf21 req-2fd31a82-57c6-46fc-b321-1827ecc0eb92 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:05.793914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-7f7f8d1d-6c58-494b-88eb-8712db09bf21 req-2fd31a82-57c6-46fc-b321-1827ecc0eb92 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:05.814628 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-7f7f8d1d-6c58-494b-88eb-8712db09bf21 req-2fd31a82-57c6-46fc-b321-1827ecc0eb92 service nova] Creating event network-changed:f5672af0-3e3f-4d09-9fb4-77322e497ab8 for instance 5617b152-0a28-4c51-98ac-11a45008d37f on hv-cinder-84814 Jun 29 16:21:05.822681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-7f7f8d1d-6c58-494b-88eb-8712db09bf21 req-2fd31a82-57c6-46fc-b321-1827ecc0eb92 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053318 Jun 29 16:21:05.824519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 580/1145] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:21:06.107026 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:06.108414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:06.117492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:06.118618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:06.119951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:06.120817 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:06.324868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:06.332898 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-204bca54-7e44-4d01-b970-f73d24d94a3d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.231530 Jun 29 16:21:06.333458 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 566/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:06 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:07.349348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:07.350071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:07.356835 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:07.357278 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:07.358027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:07.358455 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:07.518477 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:07.530472 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-22138b42-010b-4da7-a26d-2c8c8dd0158c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.185178 Jun 29 16:21:07.531055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 581/1147] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:07 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:08.556313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:08.556963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:08.565133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:08.565729 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:08.566884 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:08.567352 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:08.606564 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:08.643560 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:09.095555 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:09.104120 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a9784ca-f591-417f-aa2e-cc87e1ae5bd3 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.559146 Jun 29 16:21:09.105125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 567/1148] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:08 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:10.123540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:10.124194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:10.128663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:10.132908 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:10.133361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:10.134134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:10.134571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:10.300259 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:10.307682 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ae48a8a3-256a-4cdc-a425-6370a6cdfe0a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.189372 Jun 29 16:21:10.308571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 582/1149] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:10 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:11.325990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:11.326679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:11.333882 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:11.334323 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:11.335191 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:11.335629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:11.472305 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:11.480823 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4804c322-4b52-4237-8ea7-3a01edb6dcff tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.159236 Jun 29 16:21:11.481894 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 568/1150] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:11 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:12.497688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:12.500955 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:12.505828 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:12.506311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:12.507079 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:12.507511 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:12.699047 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:12.709823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8241da19-8ac7-4014-9c62-ae8329f1e843 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.216038 Jun 29 16:21:12.711013 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 583/1151] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:12 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:13.727273 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:13.727916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:13.734347 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:13.734797 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:13.735558 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:13.736030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:13.871618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:13.880884 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e2f20b65-66d5-4be8-924d-d989d76b0584 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.157354 Jun 29 16:21:13.881465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 569/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:13 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:14.898237 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:14.898852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:14.905539 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:14.906521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:14.907285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:14.907839 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:15.044712 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:15.052589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a4047d58-ff30-4580-9581-d437ea66a3aa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.159112 Jun 29 16:21:15.053159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 584/1153] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:14 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:16.070003 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:16.070609 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:16.077074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:16.077766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:16.078695 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:16.079118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:16.227216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:16.234457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-999fe18f-24ad-4287-ac30-6772dc836c77 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.168226 Jun 29 16:21:16.235043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 570/1154] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:16 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:17.250584 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:17.251202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:17.258829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:17.259637 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:17.261038 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:17.261481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:17.430003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:17.439214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-93586bd0-dbb0-45aa-a92e-e65e2a0c9332 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.192391 Jun 29 16:21:17.440060 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 585/1155] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:17 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:18.456677 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:18.457284 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:18.464710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:18.465158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:18.466122 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:18.466557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:18.689376 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:18.698154 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8d8186e-ac75-4ed3-a988-a7e6d40220ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.245712 Jun 29 16:21:18.698730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 571/1156] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:18 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:19.715632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:19.716215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:19.722625 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:19.723072 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:19.723833 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:19.724283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:19.864866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:19.872378 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7a5cec04-f43f-4049-a975-2fff9fa3f1bc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.160716 Jun 29 16:21:19.872941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 586/1157] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:19 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:20.889924 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:20.891190 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:20.898457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:20.898894 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:20.899644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:20.900094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:21.053679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:21.062059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-44dee765-74e6-4704-a9de-ca825db69396 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.176388 Jun 29 16:21:21.063414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 572/1158] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:20 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:22.079181 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:22.080348 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:22.092217 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:22.092654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:22.093970 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:22.094407 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:22.272703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:22.280511 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-359db241-6643-46f2-959a-92467fbb468d tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.205334 Jun 29 16:21:22.281652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 587/1159] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:22 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:22.367917 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8ebbb2a0-9b3d-4088-9cd9-0c2144ae1d43 req-bf6a072a-350f-4328-be7c-166f2944d25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5617b152-0a28-4c51-98ac-11a45008d37f", "name": "network-vif-plugged", "status": "completed", "tag": "f5672af0-3e3f-4d09-9fb4-77322e497ab8"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:22.377059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8ebbb2a0-9b3d-4088-9cd9-0c2144ae1d43 req-bf6a072a-350f-4328-be7c-166f2944d25c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:22.377640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8ebbb2a0-9b3d-4088-9cd9-0c2144ae1d43 req-bf6a072a-350f-4328-be7c-166f2944d25c service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:22.391561 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8ebbb2a0-9b3d-4088-9cd9-0c2144ae1d43 req-bf6a072a-350f-4328-be7c-166f2944d25c service nova] Creating event network-vif-plugged:f5672af0-3e3f-4d09-9fb4-77322e497ab8 for instance 5617b152-0a28-4c51-98ac-11a45008d37f on hv-cinder-84814 Jun 29 16:21:22.397083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8ebbb2a0-9b3d-4088-9cd9-0c2144ae1d43 req-bf6a072a-350f-4328-be7c-166f2944d25c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Jun 29 16:21:22.398001 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 573/1160] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:21:23.298307 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:23.298917 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:23.305705 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:23.306144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:23.307109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:23.307536 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:23.463157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:23.473222 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2f585eec-c5ae-4b62-ae00-9c9cebc58292 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1267 microversion: 2.1 time: 0.178761 Jun 29 16:21:23.473807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 588/1161] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:23 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:24.490946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:24.491646 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:24.498039 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:24.498501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:24.499260 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:24.499694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:24.668802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:24.676379 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efc86e6a-75fa-45e6-beee-7cdfd8d3f834 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1454 microversion: 2.1 time: 0.190206 Jun 29 16:21:24.676947 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 574/1162] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:24 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:24.692265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:24.692883 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:24.699349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:24.699800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:24.700607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:24.701229 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:24.704347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=97 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:24.838510 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:24.845966 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4c6af598-a8de-472f-9256-d2116737f7dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1454 microversion: 2.1 time: 0.157505 Jun 29 16:21:24.846528 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 589/1163] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:24 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:26.648715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-86e4c64e-0603-4f02-9c16-bbdf5e875349 req-236a6857-01ce-4676-a332-eca3b51afe69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5617b152-0a28-4c51-98ac-11a45008d37f", "tag": "f5672af0-3e3f-4d09-9fb4-77322e497ab8"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:26.657072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-86e4c64e-0603-4f02-9c16-bbdf5e875349 req-236a6857-01ce-4676-a332-eca3b51afe69 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:26.657518 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-86e4c64e-0603-4f02-9c16-bbdf5e875349 req-236a6857-01ce-4676-a332-eca3b51afe69 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:26.670278 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-86e4c64e-0603-4f02-9c16-bbdf5e875349 req-236a6857-01ce-4676-a332-eca3b51afe69 service nova] Creating event network-changed:f5672af0-3e3f-4d09-9fb4-77322e497ab8 for instance 5617b152-0a28-4c51-98ac-11a45008d37f on hv-cinder-84814 Jun 29 16:21:26.676976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-86e4c64e-0603-4f02-9c16-bbdf5e875349 req-236a6857-01ce-4676-a332-eca3b51afe69 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031718 Jun 29 16:21:26.680339 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 575/1164] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:21:38.291910 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=25 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:38.292713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=5 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:38.297765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1698788509", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "networks": [{"uuid": "962aabba-40c9-4328-92c9-e0e5bf5c6b42"}]}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:38.354489 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] validate_networks() for [('962aabba-40c9-4328-92c9-e0e5bf5c6b42', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:21:38.862899 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:21:38.863307 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:21:38.863807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:21:38.864349 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:21:38.864626 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:21:38.873708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:38.874149 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:38.875516 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:38.875979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:38.893156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Getting quotas for project 15a3c06b3b2d44d18cbc5dd1ed2b4b92. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:21:38.897162 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Getting quotas for user 3a08577a5f8742e0b6b5c40ce082a441 and project 15a3c06b3b2d44d18cbc5dd1ed2b4b92. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:21:38.908641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:21:38.910897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:21:38.954337 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [c7dcae8a-a614-4eae-a9e7-7f18bef8db05] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 16:21:39.966422 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [c7dcae8a-a614-4eae-a9e7-7f18bef8db05] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 52516. Jun 29 16:21:39.971311 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d03f5963-a914-4e5d-9a29-5ba95a6a3fcc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680791 Jun 29 16:21:39.971976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 590/1165] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:21:39.980077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=25 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:39.981002 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=80 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:39.987358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc76cd0d-077a-4f01-bcfd-00c7dc77e8a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:39.988259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc76cd0d-077a-4f01-bcfd-00c7dc77e8a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:40.054465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc76cd0d-077a-4f01-bcfd-00c7dc77e8a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:40.062885 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc76cd0d-077a-4f01-bcfd-00c7dc77e8a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1219 microversion: 2.1 time: 0.084554 Jun 29 16:21:40.064081 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 576/1166] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:39 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:41.081612 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:41.082740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:41.089253 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:41.089700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:41.091305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:41.091678 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:41.170648 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:41.179183 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d1b06539-b22c-4996-b19c-f2af1ae27d7e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1279 microversion: 2.1 time: 0.102548 Jun 29 16:21:41.180524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 591/1167] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:41 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:41.439640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-182830757", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "networks": [{"uuid": "f393886d-d2b2-4545-ad0f-141940c94690"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:41.492389 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] validate_networks() for [('f393886d-d2b2-4545-ad0f-141940c94690', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:21:42.096493 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:21:42.097018 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:21:42.097865 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:21:42.099016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:21:42.099016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:21:42.108715 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:42.109189 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:42.109976 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:42.110409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:42.130244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Getting quotas for project cdb6e12b57ee4841b390cb33868c65d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:21:42.134634 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Getting quotas for user cf80c8c1782b49ad9b0a526bc1039696 and project cdb6e12b57ee4841b390cb33868c65d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:21:42.147528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:21:42.150016 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:21:42.197210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:42.197820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:42.203977 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6ad40e01-7eb4-4182-addc-df7e79066ff7 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768045 Jun 29 16:21:42.204978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 577/1168] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:21:42.215087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6d6a194-12e0-499c-8442-3c79de52c436 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:42.216033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:42.217300 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6d6a194-12e0-499c-8442-3c79de52c436 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:42.222095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:42.223101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:42.226116 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:42.384252 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6d6a194-12e0-499c-8442-3c79de52c436 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:42.384718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:42.392482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6d6a194-12e0-499c-8442-3c79de52c436 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1213 microversion: 2.1 time: 0.181460 Jun 29 16:21:42.393598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 578/1169] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:42 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:42.393744 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5b37ef09-0862-4601-b20f-382162766ed8 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.200788 Jun 29 16:21:42.394593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 592/1170] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:42 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:43.025236 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-73413759-12e5-4b83-9015-406ac79ddaf7 req-8ae8a972-168b-4777-a8e4-5779a7bf3881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a068053-8401-48cf-9832-f46b71fc65ef", "tag": "efb81503-805a-4856-97d5-043e67020535"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:43.035860 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-73413759-12e5-4b83-9015-406ac79ddaf7 req-8ae8a972-168b-4777-a8e4-5779a7bf3881 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:43.036466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-73413759-12e5-4b83-9015-406ac79ddaf7 req-8ae8a972-168b-4777-a8e4-5779a7bf3881 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:43.055330 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-73413759-12e5-4b83-9015-406ac79ddaf7 req-8ae8a972-168b-4777-a8e4-5779a7bf3881 service nova] Creating event network-changed:efb81503-805a-4856-97d5-043e67020535 for instance 1a068053-8401-48cf-9832-f46b71fc65ef on hv-cinder-84814 Jun 29 16:21:43.060631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-73413759-12e5-4b83-9015-406ac79ddaf7 req-8ae8a972-168b-4777-a8e4-5779a7bf3881 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039500 Jun 29 16:21:43.061314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 579/1171] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:21:43.411532 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:43.412262 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:43.414145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:43.415344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:43.422455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:43.424459 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:43.425141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:43.426083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:43.427070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:43.434065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:43.435045 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:43.435502 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:43.509664 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:43.521385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ec805eae-d621-495d-ab0a-547d655b835d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1283 microversion: 2.1 time: 0.114922 Jun 29 16:21:43.522320 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 593/1172] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:43 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:43.769428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:43.778994 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee9a138a-af33-47b7-a0eb-202f646021b5 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.371596 Jun 29 16:21:43.779664 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 580/1173] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:43 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:44.547372 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:44.547372 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:44.551407 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:44.552132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:44.553054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:44.553493 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:44.698061 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:44.705974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8322cd7b-9f57-4b8f-b081-5009ce4f4a73 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.171456 Jun 29 16:21:44.706531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 594/1174] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:44 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:44.795938 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:44.796557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:44.802949 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:44.803406 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:44.804219 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:44.804657 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:44.933004 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:44.940377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ce2c00f1-8fab-4b2a-8d34-ded0e09a5520 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.148351 Jun 29 16:21:44.940940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 581/1175] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:44 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:45.721879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:45.722494 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:45.729117 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:45.729565 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:45.730325 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:45.730757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:45.867195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:45.875177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9ee6541a-c471-4796-9eb7-71f94136c721 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.157073 Jun 29 16:21:45.875873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 595/1176] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:45 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:45.957292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:45.957919 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:45.964372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:45.964820 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:45.965578 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:45.966008 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:46.098430 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:46.105720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93fea451-56e1-4ed3-b641-671d2c02f977 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.152329 Jun 29 16:21:46.106271 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 582/1177] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:45 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:46.894192 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:46.894828 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:46.902614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:46.903066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:46.903865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:46.904301 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:47.059242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:47.068794 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4558fecd-b363-4675-b0cd-46382f541add tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.179914 Jun 29 16:21:47.069854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 596/1178] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:46 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:47.122319 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:47.123867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:47.130750 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:47.131869 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:47.132021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:47.132381 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:47.361500 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:47.369332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-11f8e670-a2a8-420b-96db-e53a186dbb86 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.250806 Jun 29 16:21:47.369991 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 583/1179] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:47 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:47.662001 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-0d4c93e3-56d7-4c7c-8ba1-81d99007a9d5 req-1826d7f0-cf49-42eb-89e9-54ab393de7cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9f9447-4d62-4be9-afdc-a538d4f12a0f", "tag": "55523a22-6d46-4925-8bad-50ceb4f12d57"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:47.673940 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-0d4c93e3-56d7-4c7c-8ba1-81d99007a9d5 req-1826d7f0-cf49-42eb-89e9-54ab393de7cd service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:47.675245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-0d4c93e3-56d7-4c7c-8ba1-81d99007a9d5 req-1826d7f0-cf49-42eb-89e9-54ab393de7cd service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:47.689840 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-0d4c93e3-56d7-4c7c-8ba1-81d99007a9d5 req-1826d7f0-cf49-42eb-89e9-54ab393de7cd service nova] Creating event network-changed:55523a22-6d46-4925-8bad-50ceb4f12d57 for instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f on hv-cinder-84814 Jun 29 16:21:47.695250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-0d4c93e3-56d7-4c7c-8ba1-81d99007a9d5 req-1826d7f0-cf49-42eb-89e9-54ab393de7cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037947 Jun 29 16:21:47.696072 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 597/1180] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:21:48.087113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:48.087916 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:48.094945 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:48.095462 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:48.096418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:48.097114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:48.229228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:48.237770 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8a18a3f-e719-4ed4-9545-4c1f4d4baa3b tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.155091 Jun 29 16:21:48.238331 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 584/1181] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:48 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:48.387434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:48.388164 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:48.395101 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:48.395553 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:48.396437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:48.396900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:48.525157 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:48.533264 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e7857747-fdfe-4900-967e-2a9607df99cc tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.150487 Jun 29 16:21:48.533764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 598/1182] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:48 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:49.255131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:49.255741 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:49.262405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:49.262856 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:49.263613 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:49.264073 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:49.399348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:49.407436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2516e4be-0141-4500-86ec-7d91fa14c11a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.156262 Jun 29 16:21:49.408031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 585/1183] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:49 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:49.551734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:49.552456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:49.554500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:49.555388 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:49.561868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:49.562309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:49.563064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:49.563488 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:49.700543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:49.708520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1c19eb96-25db-4ea1-b1e8-24a2d8d96da4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.162403 Jun 29 16:21:49.709132 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 599/1184] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:49 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:50.424158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:50.425872 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:50.434455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:50.434909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:50.435874 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:50.436472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:50.653697 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:50.668349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4358e2dc-ef36-4d8b-9726-2de38a3e8177 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.248163 Jun 29 16:21:50.669188 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 586/1185] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:50 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:50.725583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:50.726754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:50.740737 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:50.741629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:50.743618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:50.745047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:50.894635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:50.898636 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-34efb063-6fec-48db-a2e9-84bf6ba2d9a5 req-0a7abc05-1aed-492c-9b65-77ac99e70b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a068053-8401-48cf-9832-f46b71fc65ef", "name": "network-vif-plugged", "status": "completed", "tag": "efb81503-805a-4856-97d5-043e67020535"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:50.903784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a1307eb5-c6ad-4734-bd03-79b934a4e259 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.181937 Jun 29 16:21:50.904374 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 587/1186] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:50 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:50.907503 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-34efb063-6fec-48db-a2e9-84bf6ba2d9a5 req-0a7abc05-1aed-492c-9b65-77ac99e70b82 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:50.907977 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-34efb063-6fec-48db-a2e9-84bf6ba2d9a5 req-0a7abc05-1aed-492c-9b65-77ac99e70b82 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:50.922490 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-34efb063-6fec-48db-a2e9-84bf6ba2d9a5 req-0a7abc05-1aed-492c-9b65-77ac99e70b82 service nova] Creating event network-vif-plugged:efb81503-805a-4856-97d5-043e67020535 for instance 1a068053-8401-48cf-9832-f46b71fc65ef on hv-cinder-84814 Jun 29 16:21:50.927793 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-34efb063-6fec-48db-a2e9-84bf6ba2d9a5 req-0a7abc05-1aed-492c-9b65-77ac99e70b82 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274348 Jun 29 16:21:50.928543 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 600/1187] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:21:51.685384 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:51.686002 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:51.693251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:51.693686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:51.694449 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:51.694877 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:51.829475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:51.837050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c54fc0e-e24c-4a79-9060-7e1be22bdff2 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.155766 Jun 29 16:21:51.837691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 588/1188] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:51 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:51.922835 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:51.923663 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:51.930583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:51.931152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:51.931964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:51.932402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:52.077395 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:52.085741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1ed2c8d6-e484-4f49-84f4-b8acb3d753ad tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1319 microversion: 2.1 time: 0.168088 Jun 29 16:21:52.086715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 601/1189] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:51 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:52.854050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:52.854688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:52.856681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:52.857432 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:52.863403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:52.863868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:52.864625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:52.865059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:52.942436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-37693933-3819-4620-a283-9d63bb83edd2 req-4f9b5edf-ceb2-4f80-a19b-fc7c58aff06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9f9447-4d62-4be9-afdc-a538d4f12a0f", "name": "network-vif-plugged", "status": "completed", "tag": "55523a22-6d46-4925-8bad-50ceb4f12d57"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:52.951486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-37693933-3819-4620-a283-9d63bb83edd2 req-4f9b5edf-ceb2-4f80-a19b-fc7c58aff06e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:52.952292 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-37693933-3819-4620-a283-9d63bb83edd2 req-4f9b5edf-ceb2-4f80-a19b-fc7c58aff06e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:52.964843 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-37693933-3819-4620-a283-9d63bb83edd2 req-4f9b5edf-ceb2-4f80-a19b-fc7c58aff06e service nova] Creating event network-vif-plugged:55523a22-6d46-4925-8bad-50ceb4f12d57 for instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f on hv-cinder-84814 Jun 29 16:21:52.969577 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-37693933-3819-4620-a283-9d63bb83edd2 req-4f9b5edf-ceb2-4f80-a19b-fc7c58aff06e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030867 Jun 29 16:21:52.970164 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 602/1190] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:21:52.996226 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:53.004552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-20fa4e7d-25f4-4d73-a527-15aa1bea57ec tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.154374 Jun 29 16:21:53.005150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 589/1191] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:52 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:53.103699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:53.104456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:53.111233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:53.111681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:53.112463 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:53.112898 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:53.246713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:53.255731 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-4ae320b2-77d4-4500-8030-d5920dd4c606 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1508 microversion: 2.1 time: 0.156214 Jun 29 16:21:53.256333 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 603/1192] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:53 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:54.022593 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:54.023098 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:54.030104 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:54.030556 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:54.031314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:54.031747 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:54.164021 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:54.171512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f90fc38-1311-4ce7-89ed-03d6e7aa9e69 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1313 microversion: 2.1 time: 0.153261 Jun 29 16:21:54.172103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 590/1193] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:54 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:55.188291 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:55.188896 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:55.195482 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:55.195979 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:55.196725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:55.197156 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:55.333177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:55.340869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3e2e4664-861d-4e15-ad7a-dee2d192acab tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1496 microversion: 2.1 time: 0.156296 Jun 29 16:21:55.341431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 604/1194] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:55 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:55.884740 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:55.885253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:55.892686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:55.893137 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:55.893889 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:55.894325 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:55.923100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:21:56.010062 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b08bd087-2a58-4e5c-aec4-e3fed787b3dd tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 204 len: 0 microversion: 2.1 time: 0.128871 Jun 29 16:21:56.010652 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 591/1195] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:21:55 2022] DELETE /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:21:56.019559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:56.020194 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:56.026969 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:56.027410 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:56.028400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:56.028829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:56.180631 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:56.190303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b50d6407-331d-42f3-a31e-b70222304fd4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1502 microversion: 2.1 time: 0.174886 Jun 29 16:21:56.199813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 605/1196] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:56 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:57.207779 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:57.208535 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:57.214862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:57.215301 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:57.216098 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:57.216797 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:57.353751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:57.361883 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4484c939-ea26-4b23-bcfe-64c116696509 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1502 microversion: 2.1 time: 0.159026 Jun 29 16:21:57.362446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 592/1197] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:57 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:21:58.379719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:58.380321 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:58.386571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:58.387031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:58.387778 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:58.388233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:58.527219 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:21:58.534743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-80c61450-fe7d-45ae-ad9a-44a90382a6ef tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 200 len: 1502 microversion: 2.1 time: 0.159663 Jun 29 16:21:58.535302 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 606/1198] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:58 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:21:58.833500 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-0eb2337d-d0fe-4eb1-8bcd-90df25a49468 req-ee2c97f2-d84d-4858-b7ff-0bcd755e83ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9f9447-4d62-4be9-afdc-a538d4f12a0f", "name": "network-vif-deleted", "tag": "55523a22-6d46-4925-8bad-50ceb4f12d57"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:58.844390 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-0eb2337d-d0fe-4eb1-8bcd-90df25a49468 req-ee2c97f2-d84d-4858-b7ff-0bcd755e83ca service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:58.844913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-0eb2337d-d0fe-4eb1-8bcd-90df25a49468 req-ee2c97f2-d84d-4858-b7ff-0bcd755e83ca service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:58.856501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-0eb2337d-d0fe-4eb1-8bcd-90df25a49468 req-ee2c97f2-d84d-4858-b7ff-0bcd755e83ca service nova] Creating event network-vif-deleted:55523a22-6d46-4925-8bad-50ceb4f12d57 for instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f on hv-cinder-84814 Jun 29 16:21:58.862287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-0eb2337d-d0fe-4eb1-8bcd-90df25a49468 req-ee2c97f2-d84d-4858-b7ff-0bcd755e83ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040184 Jun 29 16:21:58.863088 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 593/1199] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:21:59.552144 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:21:59.552761 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 7b9f9447-4d62-4be9-afdc-a538d4f12a0f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:21:59.559344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:59.559845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:59.560590 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:21:59.561027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:21:59.575160 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] HTTP exception thrown: Instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f could not be found. Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Request method failure captured: Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f HTTP/1.1 Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHwT0lzMB4Taifi_JxSFP5tCpXXdy_wn8yWnuaWtqm_jiWlf4a59qxrPaFszM4zaEsNZLwzywPHMyFaJszktfd3Uwxk53mzllaY12if26TYKK1-WBQTCHElAJPJ5QN7e-OI2KEEXtyHKSTKM4aRQdqN4Z6ln30nrGfyqEjNn4bCqwFY Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: cdb6e12b57ee4841b390cb33868c65d6 Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesActionsTest-1226796788 Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:21:59.576829 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cdb6e12b57ee4841b390cb33868c65d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cdb6e12b57ee4841b390cb33868c65d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cdb6e12b57ee4841b390cb33868c65d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cdb6e12b57ee4841b390cb33868c65d6", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesActionsTest-1226796788 Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: cdb6e12b57ee4841b390cb33868c65d6 Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesActionsTest-1226796788 Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesActionsTest-1226796788-project Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: cf80c8c1782b49ad9b0a526bc1039696 Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesActionsTest-1226796788-project Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f could not be found. Jun 29 16:21:59.578950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '7b9f9447-4d62-4be9-afdc-a538d4f12a0f'} Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f could not be found. Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:21:59.579982 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f could not be found. Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f could not be found. Jun 29 16:21:59.581649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:21:59.583111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Returning 404 to user: Instance 7b9f9447-4d62-4be9-afdc-a538d4f12a0f could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:21:59.583111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c7739e07-1c96-44de-a771-3ebb7ffe1935 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f" status: 404 len: 111 microversion: 2.1 time: 0.030620 Jun 29 16:21:59.583111 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 607/1200] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:21:59 2022] GET /compute/v2.1/servers/7b9f9447-4d62-4be9-afdc-a538d4f12a0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:21:59.677503 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-307213782", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "networks": [{"uuid": "f393886d-d2b2-4545-ad0f-141940c94690"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:21:59.727119 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] validate_networks() for [('f393886d-d2b2-4545-ad0f-141940c94690', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:22:00.096550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:22:00.097110 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:22:00.097471 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:22:00.098309 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:22:00.098723 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:22:00.108475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:00.108927 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:00.109723 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:00.110240 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:00.127800 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Getting quotas for project cdb6e12b57ee4841b390cb33868c65d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:22:00.132056 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Getting quotas for user cf80c8c1782b49ad9b0a526bc1039696 and project cdb6e12b57ee4841b390cb33868c65d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:22:00.143848 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:22:00.146224 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:22:00.190796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f99bce58-718b-48e6-b6ae-445e3a669188 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517480 Jun 29 16:22:00.191442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 594/1201] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:22:00.201339 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e9292513-14d7-4cfb-a82b-1835bf78409d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:00.201953 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e9292513-14d7-4cfb-a82b-1835bf78409d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:00.254179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e9292513-14d7-4cfb-a82b-1835bf78409d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:00.261454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e9292513-14d7-4cfb-a82b-1835bf78409d tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1213 microversion: 2.1 time: 0.063720 Jun 29 16:22:00.262011 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 608/1202] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:00 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:01.279408 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:01.280062 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:01.287439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:01.288040 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:01.288896 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:01.289402 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:01.309644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:01.367187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:01.376475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d95427d-1574-44ad-a258-31c9fb2496fc tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1283 microversion: 2.1 time: 0.101360 Jun 29 16:22:01.377583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 595/1203] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:01 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:02.395394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:02.396747 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:02.404708 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:02.405305 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:02.406179 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:02.406707 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:02.556968 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:02.566038 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ab9dcaf2-6e8a-43d7-8ccb-bc644dc01a68 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.175122 Jun 29 16:22:02.567031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 609/1204] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:02 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:03.056357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-b448a40c-efb6-453d-b727-77925a4aa232 req-4dff6c49-268c-47e8-88dc-cd34fc84c037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04baf51a-5170-4fe9-b1fd-12ac980aca11", "tag": "599e21e1-cd12-43bf-adcb-4c5983f8e867"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:22:03.074897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-b448a40c-efb6-453d-b727-77925a4aa232 req-4dff6c49-268c-47e8-88dc-cd34fc84c037 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:03.075360 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-b448a40c-efb6-453d-b727-77925a4aa232 req-4dff6c49-268c-47e8-88dc-cd34fc84c037 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:03.097863 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-b448a40c-efb6-453d-b727-77925a4aa232 req-4dff6c49-268c-47e8-88dc-cd34fc84c037 service nova] Creating event network-changed:599e21e1-cd12-43bf-adcb-4c5983f8e867 for instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 on hv-cinder-84814 Jun 29 16:22:03.102959 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-b448a40c-efb6-453d-b727-77925a4aa232 req-4dff6c49-268c-47e8-88dc-cd34fc84c037 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057264 Jun 29 16:22:03.103621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 596/1205] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:22:03.584478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:03.585103 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:03.591986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:03.592417 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:03.593296 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:03.593613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:03.748611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:03.752898 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:03.757782 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e6714527-c59a-4eb9-8eab-75b5b68f1550 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.177213 Jun 29 16:22:03.758359 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 610/1206] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:03 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:04.775351 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:04.776221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:04.783492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:04.784061 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:04.785051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:04.785559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:04.926517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:04.934178 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33aaff66-b529-4086-8394-c7d2847af3a3 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.163540 Jun 29 16:22:04.934734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 597/1207] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:04 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:05.951368 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:05.952051 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:05.960315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:05.960871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:05.961634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:05.962067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:06.093777 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:06.101439 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fba22a67-8e09-4972-89b4-38c291eb0153 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.154284 Jun 29 16:22:06.102002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 611/1208] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:05 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:07.118661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:07.119422 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:07.125765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:07.126250 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:07.127803 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:07.128258 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:07.265989 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:07.274180 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d13c629-fb0f-4a67-878f-d0c25f5ffc9e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.159792 Jun 29 16:22:07.274743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 598/1209] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:07 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:08.291434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:08.292202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:08.298836 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:08.299283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:08.300087 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:08.300524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:08.459189 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:08.468450 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b0aad4cd-2b3f-4fa9-8b2d-07800f6f102a tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.180602 Jun 29 16:22:08.469243 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 612/1210] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:08 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:08.536377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-37bf4ec0-a7ae-42e8-93da-f5c09ddb8772 req-e3671fec-197d-4d41-9fb2-43702252719e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04baf51a-5170-4fe9-b1fd-12ac980aca11", "name": "network-vif-plugged", "status": "completed", "tag": "599e21e1-cd12-43bf-adcb-4c5983f8e867"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:22:08.544994 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-37bf4ec0-a7ae-42e8-93da-f5c09ddb8772 req-e3671fec-197d-4d41-9fb2-43702252719e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:08.545434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-37bf4ec0-a7ae-42e8-93da-f5c09ddb8772 req-e3671fec-197d-4d41-9fb2-43702252719e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:08.558100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-37bf4ec0-a7ae-42e8-93da-f5c09ddb8772 req-e3671fec-197d-4d41-9fb2-43702252719e service nova] Creating event network-vif-plugged:599e21e1-cd12-43bf-adcb-4c5983f8e867 for instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 on hv-cinder-84814 Jun 29 16:22:08.563428 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-37bf4ec0-a7ae-42e8-93da-f5c09ddb8772 req-e3671fec-197d-4d41-9fb2-43702252719e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Jun 29 16:22:08.564164 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 599/1211] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:22:09.486244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:09.487211 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:09.489872 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:09.494741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:09.495308 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:09.496387 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:09.497145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:09.646470 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:09.657240 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-915eeebd-4ea9-484f-b698-25e9c864c483 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.175056 Jun 29 16:22:09.658430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 613/1212] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:09 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:10.676845 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:10.678638 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:10.688436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:10.690101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:10.691346 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:10.693921 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:10.695314 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:10.696999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:10.697635 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:11.279517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:11.287471 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f90a8199-bef7-4ef5-8ba8-e1f035c64fba tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1313 microversion: 2.1 time: 0.616582 Jun 29 16:22:11.290998 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 600/1213] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:10 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:12.306981 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:12.308306 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:12.311042 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:12.315526 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:12.316003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:12.316765 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:12.317220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:12.468849 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:12.478658 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6dee47de-4bcb-4627-bf2e-826964586b77 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1496 microversion: 2.1 time: 0.175904 Jun 29 16:22:12.480854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 614/1214] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:12 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1496 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:13.086660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:13.087183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:13.093864 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:13.094313 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:13.095114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:13.095542 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:13.121166 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:22:13.217831 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54dd564f-00e7-4f8d-a107-931fde16fb8e tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 204 len: 0 microversion: 2.1 time: 0.134685 Jun 29 16:22:13.218528 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 601/1215] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:22:13 2022] DELETE /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:22:13.226813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:13.227431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:13.237627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:13.238317 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:13.239086 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:13.239681 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:13.410028 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:13.418023 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-fb4bc3c5-7d87-4619-bdc8-d9f55bcba07c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1502 microversion: 2.1 time: 0.195248 Jun 29 16:22:13.418593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 615/1216] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:13 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:22:14.436405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:14.437161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:14.445216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:14.445668 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:14.446435 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:14.446868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:14.609985 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:14.619366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-95f9a3c1-3cc9-4f25-b413-28fd81ce06c1 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1502 microversion: 2.1 time: 0.187419 Jun 29 16:22:14.630348 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 602/1217] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:14 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:15.641030 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:15.641688 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:15.648186 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:15.659721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:15.661973 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:15.665049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:15.839584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-7f149d1a-3df6-467f-aaee-044691a04bef req-bad936b8-7ba0-4445-a359-4764f11d9ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04baf51a-5170-4fe9-b1fd-12ac980aca11", "name": "network-vif-deleted", "tag": "599e21e1-cd12-43bf-adcb-4c5983f8e867"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:22:15.855704 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7f149d1a-3df6-467f-aaee-044691a04bef req-bad936b8-7ba0-4445-a359-4764f11d9ee2 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:15.860332 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7f149d1a-3df6-467f-aaee-044691a04bef req-bad936b8-7ba0-4445-a359-4764f11d9ee2 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:15.870986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf80c8c1782b49ad9b0a526bc1039696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb6e12b57ee4841b390cb33868c65d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:22:15.881992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-bfa01bdc-9cfd-402e-ab0a-1057a578cb5c tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 200 len: 1460 microversion: 2.1 time: 0.248121 Jun 29 16:22:15.893361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 616/1218] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:15 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 1460 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:22:15.901753 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-7f149d1a-3df6-467f-aaee-044691a04bef req-bad936b8-7ba0-4445-a359-4764f11d9ee2 service nova] Creating event network-vif-deleted:599e21e1-cd12-43bf-adcb-4c5983f8e867 for instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 on hv-cinder-84814 Jun 29 16:22:15.909077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-7f149d1a-3df6-467f-aaee-044691a04bef req-bad936b8-7ba0-4445-a359-4764f11d9ee2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073415 Jun 29 16:22:15.910251 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 603/1219] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:22:16.905825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:16.912558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] [instance: 04baf51a-5170-4fe9-b1fd-12ac980aca11] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:16.920499 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:16.920938 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:16.924530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:16.924998 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:16.965309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] HTTP exception thrown: Instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 could not be found. Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Request method failure captured: Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 HTTP/1.1 Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHwT0lzMB4Taifi_JxSFP5tCpXXdy_wn8yWnuaWtqm_jiWlf4a59qxrPaFszM4zaEsNZLwzywPHMyFaJszktfd3Uwxk53mzllaY12if26TYKK1-WBQTCHElAJPJ5QN7e-OI2KEEXtyHKSTKM4aRQdqN4Z6ln30nrGfyqEjNn4bCqwFY Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: cdb6e12b57ee4841b390cb33868c65d6 Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesActionsTest-1226796788 Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:22:16.966989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cdb6e12b57ee4841b390cb33868c65d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cdb6e12b57ee4841b390cb33868c65d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cdb6e12b57ee4841b390cb33868c65d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cdb6e12b57ee4841b390cb33868c65d6", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesActionsTest-1226796788 Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: cdb6e12b57ee4841b390cb33868c65d6 Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesActionsTest-1226796788 Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesActionsTest-1226796788-project Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: cf80c8c1782b49ad9b0a526bc1039696 Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesActionsTest-1226796788-project Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 could not be found. Jun 29 16:22:16.968745 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '04baf51a-5170-4fe9-b1fd-12ac980aca11'} Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 could not be found. Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:22:16.969700 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 could not be found. Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 could not be found. Jun 29 16:22:16.972215 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:22:16.973483 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] Returning 404 to user: Instance 04baf51a-5170-4fe9-b1fd-12ac980aca11 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:22:16.975100 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-9f3fdd22-cd29-45ed-8656-0099bedd3cc4 tempest-VolumesActionsTest-1226796788 tempest-VolumesActionsTest-1226796788-project] 10.222.0.47 "GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11" status: 404 len: 111 microversion: 2.1 time: 0.075762 Jun 29 16:22:16.979683 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 617/1220] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:22:16 2022] GET /compute/v2.1/servers/04baf51a-5170-4fe9-b1fd-12ac980aca11 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:22:18.554353 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-35aabe43-aca8-4831-a68a-4ed6740544ba tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Action: 'create', calling method: .version_select at 0x7f0434e8a1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-232455952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI+/FzwgYkO7AA8xAIquCl0lTXrx009O6YnfF9k8IzJcJkmhcS+ZxATm8srEdHwFbG7LYh6KeHkVYqCYIn7usBN3SYZa2DQK/Zfh6tuvAZN7HviNVoCSCGkoCg32Hh4Xg=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:22:18.569446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-35aabe43-aca8-4831-a68a-4ed6740544ba tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Getting quotas for project 4f643c76310b494cad1dbe8400b50e49. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:22:18.573419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-35aabe43-aca8-4831-a68a-4ed6740544ba tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Getting quotas for user 55e6d79984cf458fa07e9997bbb9a6cb and project 4f643c76310b494cad1dbe8400b50e49. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:22:18.594968 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-35aabe43-aca8-4831-a68a-4ed6740544ba tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.215871 Jun 29 16:22:18.595557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 604/1221] 10.222.0.47 () {60 vars in 1158 bytes} [Wed Jun 29 16:22:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:22:23.436939 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2de2c64f-3943-46fe-aa9c-7c3daff0fc43", "device": "/dev/sdb"}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:22:23.439070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:23.445511 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:23.445989 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:23.446751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:23.447218 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:23.691440 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e3835183-05f2-4fec-b09e-861af9827f7d tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "POST /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258090 Jun 29 16:22:23.692102 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 618/1222] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:22:23 2022] POST /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:22:57.923295 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:57.924084 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:57.924868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:57.929090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:22:57.929690 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:22:57.937807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:57.938259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:57.939030 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:22:57.940437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:22:58.027520 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lazy-loading 'services' on Instance uuid 1a068053-8401-48cf-9832-f46b71fc65ef {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:22:58.107659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3363056f-52de-4b1d-8dfd-74c30e57f708 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef/os-volume_attachments/2de2c64f-3943-46fe-aa9c-7c3daff0fc43" status: 202 len: 0 microversion: 2.1 time: 0.185306 Jun 29 16:22:58.108293 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 605/1223] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:22:57 2022] DELETE /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef/os-volume_attachments/2de2c64f-3943-46fe-aa9c-7c3daff0fc43 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:23:00.058611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=11 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:00.059514 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:00.064950 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1317567988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-232455952", "security_groups": [{"name": "tempest-secgroup-smoke-1600536974"}], "networks": [{"uuid": "8e3ab8ea-f1dc-4b02-b5c8-b0097bf693a4"}], "block_device_mapping_v2": [{"uuid": "9accbd72-9dd6-495b-8551-ad269bae1b75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:00.185667 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] validate_networks() for [('8e3ab8ea-f1dc-4b02-b5c8-b0097bf693a4', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:23:00.288782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:00.289457 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:00.297372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:00.298466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:00.299320 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:00.299840 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:00.326060 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:23:00.409044 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac91bfc8-73cb-4196-bdbc-5b5de0f4c9b0 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 204 len: 0 microversion: 2.1 time: 0.125452 Jun 29 16:23:00.410479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 606/1224] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:23:00 2022] DELETE /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 16:23:00.419327 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:00.420177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:00.426388 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:00.426838 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:00.427600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:00.428071 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:00.564092 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:00.566501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:23:00.566921 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:23:00.567390 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:23:00.567802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:23:00.568242 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:23:00.573754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0496a07-b499-4f38-9487-cbe5695da8a9 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1514 microversion: 2.1 time: 0.158646 Jun 29 16:23:00.574321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 607/1225] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:00 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:23:00.577332 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:00.577809 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:00.578610 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:00.579044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:00.596122 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Getting quotas for project 4f643c76310b494cad1dbe8400b50e49. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:23:00.600853 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Getting quotas for user 55e6d79984cf458fa07e9997bbb9a6cb and project 4f643c76310b494cad1dbe8400b50e49. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:23:00.662354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:23:00.664642 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9accbd72-9dd6-495b-8551-ad269bae1b75',volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:23:00.799180 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-32cd0cb7-b163-4c0f-89ed-4e8ef79e6df5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742240 Jun 29 16:23:00.799741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 619/1226] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:23:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:23:00.809691 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34b2a205-bf64-44ff-ac74-d06b694b4eea tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:00.810442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34b2a205-bf64-44ff-ac74-d06b694b4eea tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:00.868774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34b2a205-bf64-44ff-ac74-d06b694b4eea tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:00.875746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34b2a205-bf64-44ff-ac74-d06b694b4eea tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1088 microversion: 2.1 time: 0.069999 Jun 29 16:23:00.876356 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 608/1227] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:00 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:01.591863 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:01.592468 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:01.599334 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:01.599774 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:01.600546 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:01.600972 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:01.729504 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:01.737193 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-564c9351-0fbe-4f83-9082-699ef7c90f7b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1514 microversion: 2.1 time: 0.149705 Jun 29 16:23:01.738493 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 620/1228] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:01 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:01.894826 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:01.895409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:01.902790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:01.903237 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:01.904037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:01.904479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:01.976509 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:01.985244 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d818601a-d5da-47e9-871b-2330ab1cea9b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1138 microversion: 2.1 time: 0.095597 Jun 29 16:23:01.986043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 609/1229] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:01 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:02.755115 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:02.755757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:02.762370 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:02.762900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:02.763656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:02.764560 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:02.903675 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:02.914044 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-745ea067-340a-4f11-86fd-4965f46ca3c4 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 200 len: 1514 microversion: 2.1 time: 0.163395 Jun 29 16:23:02.914634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 621/1230] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:02 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:03.002479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:03.003511 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:03.010158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:03.010624 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:03.011376 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:03.011807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:03.086942 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:03.094899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efb298cf-7a50-4b23-84ca-af6f1e08ca59 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1186 microversion: 2.1 time: 0.096282 Jun 29 16:23:03.095472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 610/1231] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:02 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:03.204297 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-4ab7691c-6508-402a-af51-373506f40f58 req-be5f168a-3351-4a8c-b058-eb731d717734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a068053-8401-48cf-9832-f46b71fc65ef", "name": "network-vif-deleted", "tag": "efb81503-805a-4856-97d5-043e67020535"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:03.212827 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-4ab7691c-6508-402a-af51-373506f40f58 req-be5f168a-3351-4a8c-b058-eb731d717734 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:03.213269 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-4ab7691c-6508-402a-af51-373506f40f58 req-be5f168a-3351-4a8c-b058-eb731d717734 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:03.225854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-4ab7691c-6508-402a-af51-373506f40f58 req-be5f168a-3351-4a8c-b058-eb731d717734 service nova] Creating event network-vif-deleted:efb81503-805a-4856-97d5-043e67020535 for instance 1a068053-8401-48cf-9832-f46b71fc65ef on hv-cinder-84814 Jun 29 16:23:03.233623 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-4ab7691c-6508-402a-af51-373506f40f58 req-be5f168a-3351-4a8c-b058-eb731d717734 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Jun 29 16:23:03.235990 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 622/1232] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:23:03.931455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:03.932199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 1a068053-8401-48cf-9832-f46b71fc65ef] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:03.938537 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:03.939099 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:03.939953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:03.940386 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:03.956418 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] HTTP exception thrown: Instance 1a068053-8401-48cf-9832-f46b71fc65ef could not be found. Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Request method failure captured: Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef HTTP/1.1 Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHwQVukc9NNvLI_Kn_HL0C2woIYdIRVTX7daYLxPOMHrGNs5S2-lLFNmhI2bxaj2oDYI8-wyRx5m_CLx43YUh4jT68Scfne3mVPDhMkAc0124aiGY9_AAkTc0HmwSzEB1i6c79_Jz3XpUlG8BFCoC5weIFo3ocbFnbVbR-NsaTupXxI Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 15a3c06b3b2d44d18cbc5dd1ed2b4b92 Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotTestJSON-864081586 Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:23:03.958080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/15a3c06b3b2d44d18cbc5dd1ed2b4b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/15a3c06b3b2d44d18cbc5dd1ed2b4b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/15a3c06b3b2d44d18cbc5dd1ed2b4b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_15a3c06b3b2d44d18cbc5dd1ed2b4b92", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotTestJSON-864081586 Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 15a3c06b3b2d44d18cbc5dd1ed2b4b92 Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-864081586 Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotTestJSON-864081586-project Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 3a08577a5f8742e0b6b5c40ce082a441 Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotTestJSON-864081586-project Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 1a068053-8401-48cf-9832-f46b71fc65ef could not be found. Jun 29 16:23:03.959816 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '1a068053-8401-48cf-9832-f46b71fc65ef'} Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a068053-8401-48cf-9832-f46b71fc65ef could not be found. Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:23:03.960720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a068053-8401-48cf-9832-f46b71fc65ef could not be found. Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a068053-8401-48cf-9832-f46b71fc65ef could not be found. Jun 29 16:23:03.962054 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:23:03.963287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Returning 404 to user: Instance 1a068053-8401-48cf-9832-f46b71fc65ef could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:23:03.963287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fda21423-13e4-4e0c-acec-f326fdf12d01 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef" status: 404 len: 111 microversion: 2.1 time: 0.032044 Jun 29 16:23:03.963287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 611/1233] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:03 2022] GET /compute/v2.1/servers/1a068053-8401-48cf-9832-f46b71fc65ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:23:04.114622 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:04.116371 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:04.124221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:04.134830 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:04.135352 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:04.135814 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:04.208716 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:04.216671 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-950c2caf-e287-42a7-a2d9-26a1f2afef7b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1204 microversion: 2.1 time: 0.107701 Jun 29 16:23:04.217246 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 623/1234] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:04 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:23:05.233762 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:05.234375 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:05.241049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:05.241363 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:05.242111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:05.242542 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:05.248082 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-6b2a65fb-2a4b-421c-b7cf-2fd21ee39220 req-bb4074a7-e163-4e74-a4be-608dc889fecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:05.260205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-6b2a65fb-2a4b-421c-b7cf-2fd21ee39220 req-bb4074a7-e163-4e74-a4be-608dc889fecf service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:05.260591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-6b2a65fb-2a4b-421c-b7cf-2fd21ee39220 req-bb4074a7-e163-4e74-a4be-608dc889fecf service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:05.272496 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-6b2a65fb-2a4b-421c-b7cf-2fd21ee39220 req-bb4074a7-e163-4e74-a4be-608dc889fecf service nova] Creating event network-changed:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:23:05.280074 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-6b2a65fb-2a4b-421c-b7cf-2fd21ee39220 req-bb4074a7-e163-4e74-a4be-608dc889fecf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033431 Jun 29 16:23:05.280740 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 624/1235] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:23:05.637734 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:05.645736 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43bd10e2-26ba-4dc1-bc1b-2c7155614257 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.415764 Jun 29 16:23:05.646306 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 612/1236] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:05 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:06.663719 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:06.664351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:06.670542 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:06.670986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:06.671735 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:06.672195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:06.798746 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:06.808787 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f4b8089f-c880-4873-a1ee-7c60bbc3b021 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.149538 Jun 29 16:23:06.809752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 625/1237] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:06 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:07.827097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:07.827735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:07.835066 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:07.835517 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:07.836321 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:07.836747 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:07.975052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:07.982581 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-87b825ea-0e05-43ec-8059-4873261e21a4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.160399 Jun 29 16:23:07.983134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 613/1238] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:07 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:08.998854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:08.999464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:09.006561 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:09.007008 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:09.007762 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:09.008220 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:09.148479 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:09.155804 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-804b8710-a6df-4e88-82ee-fdb085a46586 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.160877 Jun 29 16:23:09.156399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 626/1239] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:08 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:10.172439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:10.172968 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:10.179974 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:10.180419 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:10.181206 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:10.181640 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:10.311541 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:10.319699 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e1cc7f5-f5a0-425d-ba3b-17c176b16d79 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.151076 Jun 29 16:23:10.320218 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 614/1240] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:10 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:11.336265 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:11.337596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:11.344420 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:11.346492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:11.348602 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:11.349140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:11.350145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:11.350865 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:11.501583 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:11.517817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c46accaa-6fc0-47f5-82bf-7f02e520f8d8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.184814 Jun 29 16:23:11.518766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 627/1241] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:11 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:12.536804 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:12.537447 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:12.539444 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:12.545437 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:12.545878 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:12.546629 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:12.547052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:12.681136 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:12.689087 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-190b0a2d-57bf-4868-a579-0d552576e4fd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.157399 Jun 29 16:23:12.689538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 615/1242] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:12 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:13.707105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:13.708385 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:13.717002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:13.717837 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:13.719083 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:13.719742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:13.864581 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:13.871962 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-d840fee6-a744-499d-a255-6b2f02c1c789 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.169418 Jun 29 16:23:13.872531 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 628/1243] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:13 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:14.888443 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:14.889050 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:14.895803 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:14.896304 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:14.897052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:14.897481 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:15.024214 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:15.031592 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4d09f334-7db5-44b0-9542-a9dbb1286255 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.146985 Jun 29 16:23:15.032182 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 616/1244] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:14 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:16.048412 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:16.049049 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:16.056139 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:16.056530 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:16.057279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:16.057724 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:16.189148 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:16.197177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-250553c8-bae9-4fef-8405-d0284d2660d9 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.152607 Jun 29 16:23:16.197782 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 629/1245] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:16 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:17.213970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:17.214534 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:17.221284 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:17.221733 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:17.222482 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:17.223434 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:17.355774 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:17.363281 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8be8c53-3a66-4e9b-8d78-483b73bac791 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.153261 Jun 29 16:23:17.364516 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 617/1246] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:17 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:18.381017 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:18.381634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:18.388199 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:18.388641 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:18.389649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:18.390085 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:18.519487 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:18.527036 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7dc0fcbe-af02-4b1b-8929-1761fa90de14 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.150460 Jun 29 16:23:18.527629 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 630/1247] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:18 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:19.544153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:19.544692 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:19.551773 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:19.552235 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:19.552979 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:19.553405 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:19.681550 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:19.689037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1f86f800-0e9f-4dae-96b7-8b2324f4f8cf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.148828 Jun 29 16:23:19.689598 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 618/1248] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:19 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:20.044362 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1448611199", "imageRef": "4b3e5f2e-c8a8-4892-afb8-fa00234a5d81", "flavorRef": "452", "networks": [{"uuid": "962aabba-40c9-4328-92c9-e0e5bf5c6b42"}]}} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:20.094823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.network.neutron [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] validate_networks() for [('962aabba-40c9-4328-92c9-e0e5bf5c6b42', None, None, None, None, None)] {{(pid=117728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:23:20.428670 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Flavor limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:23:20.429088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Image limits 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:23:20.429558 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Flavor pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:23:20.429988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Image pref 0:0:0 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:23:20.430387 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.virt.hardware [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:23:20.439104 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:20.439549 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:20.440376 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:20.440825 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:20.458351 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Getting quotas for project 15a3c06b3b2d44d18cbc5dd1ed2b4b92. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:23:20.462170 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.quota [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Getting quotas for user 3a08577a5f8742e0b6b5c40ce082a441 and project 15a3c06b3b2d44d18cbc5dd1ed2b4b92. Resources: {'cores', 'instances', 'ram'} {{(pid=117728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:23:20.472846 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Going to run 1 instances... {{(pid=117728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:23:20.475274 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b3e5f2e-c8a8-4892-afb8-fa00234a5d81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:23:20.522772 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cf664640-ce95-4208-8747-b368bbdcf747 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482136 Jun 29 16:23:20.528501 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 631/1249] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:23:20.533566 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9003c634-cc6b-4f9a-b987-80e974278434 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:20.534201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9003c634-cc6b-4f9a-b987-80e974278434 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:20.590545 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9003c634-cc6b-4f9a-b987-80e974278434 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:20.597242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9003c634-cc6b-4f9a-b987-80e974278434 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1219 microversion: 2.1 time: 0.067688 Jun 29 16:23:20.597965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 619/1250] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:20 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:20.706037 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:20.706759 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:20.714098 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:20.714452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:20.715202 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:20.715634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:20.852071 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:20.859802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-7c9f9dfb-97c2-4b7e-8aab-26ecee5d6485 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.158419 Jun 29 16:23:20.867891 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 632/1251] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:20 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:21.614409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:21.615118 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:21.624198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:21.624756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:21.625529 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:21.626032 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:21.691867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:21.700115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d08bece6-b7ac-4d0a-b299-bc78fbff9b58 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1271 microversion: 2.1 time: 0.089598 Jun 29 16:23:21.700679 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 620/1252] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:21 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:21.877721 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:21.879647 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:21.885932 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:21.886382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:21.887146 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:21.887752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:22.024177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:22.033506 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b47e34d8-05ea-4474-9de5-a4e0b5b6178b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.158985 Jun 29 16:23:22.042619 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 633/1253] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:21 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:22.718036 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:22.718600 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:22.725884 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:22.726338 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:22.727094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:22.727527 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:22.924055 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:22.928052 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:22.933372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc81f7cb-ade0-49a1-bfd8-7df6cc2a0e54 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.219347 Jun 29 16:23:22.933973 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 621/1254] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:22 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:23.048911 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:23.049589 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:23.056134 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:23.056574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:23.057321 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:23.057749 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:23.182746 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-fec42205-4997-4258-a60a-503dde1e79de req-b430e8b7-07b1-45c4-8be6-2a1588e120cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3448d4fc-a05a-486e-8169-545b2d74d002", "tag": "ea67e744-aa06-4c5a-8a8c-a54aa9fc83e9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:23.194049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-fec42205-4997-4258-a60a-503dde1e79de req-b430e8b7-07b1-45c4-8be6-2a1588e120cc service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:23.197642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-fec42205-4997-4258-a60a-503dde1e79de req-b430e8b7-07b1-45c4-8be6-2a1588e120cc service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:23.201730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:23.211239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-fec42205-4997-4258-a60a-503dde1e79de req-b430e8b7-07b1-45c4-8be6-2a1588e120cc service nova] Creating event network-changed:ea67e744-aa06-4c5a-8a8c-a54aa9fc83e9 for instance 3448d4fc-a05a-486e-8169-545b2d74d002 on hv-cinder-84814 Jun 29 16:23:23.216230 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-fec42205-4997-4258-a60a-503dde1e79de req-b430e8b7-07b1-45c4-8be6-2a1588e120cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036905 Jun 29 16:23:23.216841 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 622/1255] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:23:23.218869 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1c632723-e6ef-4352-aa88-a93b04d10d32 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.173845 Jun 29 16:23:23.220706 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 634/1256] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:23 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:23.764716 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-37f153f1-025b-4c30-86b2-7387cbb9cd94 req-7b140542-bef5-4cb1-87c5-0813fde35d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "name": "network-vif-plugged", "status": "completed", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:23.773695 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-37f153f1-025b-4c30-86b2-7387cbb9cd94 req-7b140542-bef5-4cb1-87c5-0813fde35d52 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:23.774417 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-37f153f1-025b-4c30-86b2-7387cbb9cd94 req-7b140542-bef5-4cb1-87c5-0813fde35d52 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:23.786694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-37f153f1-025b-4c30-86b2-7387cbb9cd94 req-7b140542-bef5-4cb1-87c5-0813fde35d52 service nova] Creating event network-vif-plugged:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:23:23.791765 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-37f153f1-025b-4c30-86b2-7387cbb9cd94 req-7b140542-bef5-4cb1-87c5-0813fde35d52 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032180 Jun 29 16:23:23.792487 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 623/1257] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:23:23.955400 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:23.956424 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:23.963984 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:23.964541 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:23.965491 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:23.966430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:24.107408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:24.116087 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a8cf680f-6b24-40ff-b894-ede5952a3fbd tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.169328 Jun 29 16:23:24.116620 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 635/1258] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:23 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:24.237341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:24.238101 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:24.244216 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:24.244659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:24.245413 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:24.245875 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:24.373243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:24.380695 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-038a2624-44a5-496e-99b8-606d903736d4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.147713 Jun 29 16:23:24.381242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 624/1259] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:24 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:25.134309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:25.134957 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:25.141713 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:25.142151 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:25.142893 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:25.143322 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:25.276201 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:25.284110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-b456919c-7ef1-4865-8ef7-9a5ef7734875 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.153671 Jun 29 16:23:25.284734 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 636/1260] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:25 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:25.397818 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:25.398442 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:25.404905 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:25.405350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:25.406153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:25.406580 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:25.549583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:25.557461 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-706d19f8-d372-4a4f-a963-aa6895091868 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.163605 Jun 29 16:23:25.558019 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 625/1261] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:25 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:26.300834 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:26.301448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:26.308262 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:26.308709 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:26.309469 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:26.309902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:26.438437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:26.449342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-445d9d15-0c8b-4922-bc50-59064bd0f830 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.152356 Jun 29 16:23:26.449925 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 637/1262] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:26 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:26.574513 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:26.575134 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:26.581548 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:26.582029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:26.582783 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:26.583209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:26.722673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:26.731655 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a55d817d-8db0-4ef0-b2aa-caa07e03fd4d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.160859 Jun 29 16:23:26.733201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 626/1263] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:26 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:23:27.467770 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:27.468321 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:27.475486 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:27.475976 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:27.476725 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:27.477159 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:27.481052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=100 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:27.603687 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:27.611327 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-96e1c17d-6218-40c2-a210-99aaafbb9c96 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.147635 Jun 29 16:23:27.611943 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 638/1264] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:27 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:27.749336 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:27.750038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:27.757282 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:27.757730 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:27.758485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:27.758918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:27.897374 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:27.905148 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7e84cf0a-c9a9-4899-bd10-74914b3d3161 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1260 microversion: 2.1 time: 0.159614 Jun 29 16:23:27.905705 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 627/1265] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:27 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:28.628521 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:28.629150 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:28.635603 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:28.636074 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:28.636820 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:28.637250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:28.762382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:28.774213 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-a0dc2f66-1fd3-49e8-9344-def980ccec35 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.149488 Jun 29 16:23:28.774813 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 639/1266] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:28 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:28.921901 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:28.922454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:28.924868 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:28.930138 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:28.930582 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:28.931337 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:28.931767 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:29.059193 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:29.066666 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1762567c-6f3a-4f0d-b4ed-cc41d7bfc79e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1444 microversion: 2.1 time: 0.148688 Jun 29 16:23:29.067738 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 628/1267] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:28 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:29.083596 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:29.084478 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:29.090764 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:29.091411 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:29.092209 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:29.092685 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:29.230500 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:29.237913 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-36f2698d-3dac-4fae-b7c2-8a2add2c18f6 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1444 microversion: 2.1 time: 0.158768 Jun 29 16:23:29.238475 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 640/1268] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:29 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:29.794445 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:29.795173 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:29.801978 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:29.802433 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:29.803196 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:29.803633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:30.033557 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:30.041768 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e305dad2-f78e-413f-84e3-5f9b164c47eb tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.251186 Jun 29 16:23:30.043109 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 629/1269] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:29 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:31.058885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:31.059481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:31.061901 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:31.062779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:31.063268 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:31.070210 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:31.070658 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:31.071430 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:31.071887 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:31.206715 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:31.217279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-030b5d79-9204-4d62-8ff5-e77db26c4185 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.162274 Jun 29 16:23:31.217850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 641/1270] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:31 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:31.283173 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-5835eeb3-ea81-4031-9ff6-682756e3ff79 req-e0b3804b-f8d6-4cc1-b904-8d348ad178f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:31.286686 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:31.292631 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5835eeb3-ea81-4031-9ff6-682756e3ff79 req-e0b3804b-f8d6-4cc1-b904-8d348ad178f3 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:31.293067 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5835eeb3-ea81-4031-9ff6-682756e3ff79 req-e0b3804b-f8d6-4cc1-b904-8d348ad178f3 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:31.304852 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-5835eeb3-ea81-4031-9ff6-682756e3ff79 req-e0b3804b-f8d6-4cc1-b904-8d348ad178f3 service nova] Creating event network-changed:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:23:31.310201 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-5835eeb3-ea81-4031-9ff6-682756e3ff79 req-e0b3804b-f8d6-4cc1-b904-8d348ad178f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031132 Jun 29 16:23:31.310720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 630/1271] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:23:32.233886 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:32.234517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:32.241283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:32.241832 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:32.242697 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:32.243196 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:32.384438 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:32.392753 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ea946b6e-9cba-496e-93cc-61d133c08392 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.162709 Jun 29 16:23:32.393527 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 642/1272] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:32 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:33.411475 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:33.412199 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:33.418424 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:33.418881 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:33.419637 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:33.420103 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:33.547947 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:33.555963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6eaa1b9-a299-43a4-b2d5-f9416603066a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.149289 Jun 29 16:23:33.556536 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 631/1273] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:33 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:33.715524 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-298e0cd7-2d6e-4399-a66a-45dace866fe7 req-d7f47dcd-bf1f-4c80-a09f-516ae258c96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3448d4fc-a05a-486e-8169-545b2d74d002", "name": "network-vif-plugged", "status": "completed", "tag": "ea67e744-aa06-4c5a-8a8c-a54aa9fc83e9"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:33.725321 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-298e0cd7-2d6e-4399-a66a-45dace866fe7 req-d7f47dcd-bf1f-4c80-a09f-516ae258c96f service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:33.726289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-298e0cd7-2d6e-4399-a66a-45dace866fe7 req-d7f47dcd-bf1f-4c80-a09f-516ae258c96f service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:33.739569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-298e0cd7-2d6e-4399-a66a-45dace866fe7 req-d7f47dcd-bf1f-4c80-a09f-516ae258c96f service nova] Creating event network-vif-plugged:ea67e744-aa06-4c5a-8a8c-a54aa9fc83e9 for instance 3448d4fc-a05a-486e-8169-545b2d74d002 on hv-cinder-84814 Jun 29 16:23:33.744769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-298e0cd7-2d6e-4399-a66a-45dace866fe7 req-d7f47dcd-bf1f-4c80-a09f-516ae258c96f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033140 Jun 29 16:23:33.745386 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 643/1274] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:23:34.573308 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:34.573914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:34.580422 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:34.580861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:34.581603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:34.582031 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:34.712611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:34.719957 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5ca46a4f-a64b-46b8-ba82-e5ddb971a64b tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1319 microversion: 2.1 time: 0.150441 Jun 29 16:23:34.720519 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 632/1275] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:34 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:35.738449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:23:35.739153 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:35.745409 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:35.745846 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:35.746591 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:35.747017 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:35.876930 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:23:35.885165 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-19b4c0e9-9342-4e54-8770-89241f0a5a4c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1507 microversion: 2.1 time: 0.151318 Jun 29 16:23:35.885732 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 644/1276] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:23:35 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:23:35.903130 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49eb2383-5aca-4733-a5c8-2bbc8881c5ec", "device": "/dev/sdb"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:23:35.905015 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:23:35.911228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:35.911790 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:35.912633 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:23:35.913111 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:23:36.158941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9b761508-d672-45fa-916c-9f3dacd2546e tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "POST /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260030 Jun 29 16:23:36.159639 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 633/1277] 10.222.0.47 () {60 vars in 1322 bytes} [Wed Jun 29 16:23:35 2022] POST /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:24:04.685854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:04.686434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:04.688535 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=7 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:04.689216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=36 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:04.694841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:04.695289 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:04.696080 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:04.696519 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:04.773456 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.objects.instance [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lazy-loading 'services' on Instance uuid 3448d4fc-a05a-486e-8169-545b2d74d002 {{(pid=117728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:24:04.845257 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-338cbb40-8f2f-4676-8d0c-2825cbe972a1 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002/os-volume_attachments/49eb2383-5aca-4733-a5c8-2bbc8881c5ec" status: 202 len: 0 microversion: 2.1 time: 0.163279 Jun 29 16:24:04.845831 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 645/1278] 10.222.0.47 () {58 vars in 1415 bytes} [Wed Jun 29 16:24:04 2022] DELETE /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002/os-volume_attachments/49eb2383-5aca-4733-a5c8-2bbc8881c5ec => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:24:06.670463 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=11 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:06.671231 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:06.675401 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1815853809", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1528332792", "security_groups": [{"name": "tempest-secgroup-smoke-1095340995"}], "block_device_mapping_v2": [{"uuid": "552a88fe-0221-4982-a824-d2a5279f5f01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1a48c25-8bb7-4e07-98a2-dce74f3bae14"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:24:06.789775 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] validate_networks() for [('b1a48c25-8bb7-4e07-98a2-dce74f3bae14', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 16:24:07.007779 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:07.008401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:07.014844 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:07.015283 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:07.016123 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:07.016556 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:07.041866 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:24:07.127627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-3f14145d-3da5-40a7-b7c2-d900421c0d5c tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 204 len: 0 microversion: 2.1 time: 0.123275 Jun 29 16:24:07.128216 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 646/1279] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:24:07 2022] DELETE /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 16:24:07.138718 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:07.139414 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:07.145656 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:07.146110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:07.146871 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:07.147303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:07.253784 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 16:24:07.254209 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 16:24:07.254674 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 16:24:07.255077 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 16:24:07.255483 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 16:24:07.264975 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:07.265393 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:07.266187 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:07.266618 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:07.279576 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:07.283835 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 16:24:07.287003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-62d00c3b-c258-478b-8201-7de6344abc61 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1513 microversion: 2.1 time: 0.152803 Jun 29 16:24:07.287567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 647/1280] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:07 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:24:07.288453 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Getting quotas for user da01cd253f6e4bc792868f337ff85b0a and project 8c561382be984c2b9c1285c6e5b6268a. Resources: {'cores', 'instances', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 16:24:07.347969 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 16:24:07.350173 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='552a88fe-0221-4982-a824-d2a5279f5f01',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 16:24:07.474547 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [146155a2-ea6b-461a-b952-5ca58433e96a] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 16:24:08.304489 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:08.305140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:08.312214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:08.312660 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:08.313407 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:08.313838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:08.438855 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:08.446354 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6ebb4ed7-a899-4df6-8844-6182d9baf5f7 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1513 microversion: 2.1 time: 0.145729 Jun 29 16:24:08.446964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 648/1281] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:08 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:24:08.483472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [146155a2-ea6b-461a-b952-5ca58433e96a] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54318. Jun 29 16:24:08.487379 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d82449d-9a56-476f-8993-2597db416533 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.818421 Jun 29 16:24:08.488049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 634/1282] 10.222.0.47 () {60 vars in 1146 bytes} [Wed Jun 29 16:24:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 16:24:08.498002 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-1f54f7b7-c529-478d-9312-8d2b07811182 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:08.498639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-1f54f7b7-c529-478d-9312-8d2b07811182 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:08.783452 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-1f54f7b7-c529-478d-9312-8d2b07811182 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:08.790292 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-1f54f7b7-c529-478d-9312-8d2b07811182 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1095 microversion: 2.1 time: 0.296268 Jun 29 16:24:08.791033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 649/1283] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:08 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1095 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:09.465008 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:09.465716 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:09.472162 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:09.472611 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:09.473420 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:09.474017 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:09.688644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a08577a5f8742e0b6b5c40ce082a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:09.696341 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c9a82ade-2da8-497a-b69f-4cbda3385056 tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 200 len: 1513 microversion: 2.1 time: 0.236316 Jun 29 16:24:09.697522 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 635/1284] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:09 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:09.807743 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:09.808367 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:09.815646 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:09.816336 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:09.817094 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:09.817517 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:09.881592 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:09.893344 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2d9b883f-9a62-44a9-a242-6b88dd00aa03 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1201 microversion: 2.1 time: 0.089987 Jun 29 16:24:09.894075 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 650/1285] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:09 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:10.010900 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-fc715ce7-80d8-466e-8b59-fb5c2eebd7e4 req-a1aa92ac-4a57-451e-b3aa-917772b627c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3448d4fc-a05a-486e-8169-545b2d74d002", "name": "network-vif-deleted", "tag": "ea67e744-aa06-4c5a-8a8c-a54aa9fc83e9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:24:10.019786 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-fc715ce7-80d8-466e-8b59-fb5c2eebd7e4 req-a1aa92ac-4a57-451e-b3aa-917772b627c3 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:10.020253 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-fc715ce7-80d8-466e-8b59-fb5c2eebd7e4 req-a1aa92ac-4a57-451e-b3aa-917772b627c3 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:10.034125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-fc715ce7-80d8-466e-8b59-fb5c2eebd7e4 req-a1aa92ac-4a57-451e-b3aa-917772b627c3 service nova] Creating event network-vif-deleted:ea67e744-aa06-4c5a-8a8c-a54aa9fc83e9 for instance 3448d4fc-a05a-486e-8169-545b2d74d002 on hv-cinder-84814 Jun 29 16:24:10.049559 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-fc715ce7-80d8-466e-8b59-fb5c2eebd7e4 req-a1aa92ac-4a57-451e-b3aa-917772b627c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Jun 29 16:24:10.050400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 636/1286] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:24:10.715446 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:10.716293 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] [instance: 3448d4fc-a05a-486e-8169-545b2d74d002] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:10.723703 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:10.724568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:10.725389 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:10.725823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:10.743454 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] HTTP exception thrown: Instance 3448d4fc-a05a-486e-8169-545b2d74d002 could not be found. Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Request method failure captured: Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 HTTP/1.1 Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHwQVukc9NNvLI_Kn_HL0C2woIYdIRVTX7daYLxPOMHrGNs5S2-lLFNmhI2bxaj2oDYI8-wyRx5m_CLx43YUh4jT68Scfne3mVPDhMkAc0124aiGY9_AAkTc0HmwSzEB1i6c79_Jz3XpUlG8BFCoC5weIFo3ocbFnbVbR-NsaTupXxI Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 15a3c06b3b2d44d18cbc5dd1ed2b4b92 Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-VolumesSnapshotTestJSON-864081586 Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:24:10.745802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/15a3c06b3b2d44d18cbc5dd1ed2b4b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/15a3c06b3b2d44d18cbc5dd1ed2b4b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/15a3c06b3b2d44d18cbc5dd1ed2b4b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_15a3c06b3b2d44d18cbc5dd1ed2b4b92", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-VolumesSnapshotTestJSON-864081586 Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 15a3c06b3b2d44d18cbc5dd1ed2b4b92 Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-864081586 Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-VolumesSnapshotTestJSON-864081586-project Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: 3a08577a5f8742e0b6b5c40ce082a441 Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-VolumesSnapshotTestJSON-864081586-project Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 3448d4fc-a05a-486e-8169-545b2d74d002 could not be found. Jun 29 16:24:10.747652 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '3448d4fc-a05a-486e-8169-545b2d74d002'} Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3448d4fc-a05a-486e-8169-545b2d74d002 could not be found. Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:24:10.748695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3448d4fc-a05a-486e-8169-545b2d74d002 could not be found. Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3448d4fc-a05a-486e-8169-545b2d74d002 could not be found. Jun 29 16:24:10.750303 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:24:10.752533 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] Returning 404 to user: Instance 3448d4fc-a05a-486e-8169-545b2d74d002 could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:24:10.753563 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-882089c7-b23e-4cff-bb95-4ca209f3229a tempest-VolumesSnapshotTestJSON-864081586 tempest-VolumesSnapshotTestJSON-864081586-project] 10.222.0.47 "GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002" status: 404 len: 111 microversion: 2.1 time: 0.043396 Jun 29 16:24:10.755900 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 651/1287] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:10 2022] GET /compute/v2.1/servers/3448d4fc-a05a-486e-8169-545b2d74d002 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:24:10.912051 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:10.913038 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:10.924242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:10.924776 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:10.925887 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:10.926414 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:11.160747 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:11.168273 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c69841bb-6e8f-45fb-bffa-5ef76ac2d48a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.261325 Jun 29 16:24:11.168849 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 637/1288] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:10 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:12.066945 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-1886e880-2a13-42cb-8738-1e08f270ba19 req-224090a2-d343-47ed-b74e-5ead0c6dba10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a8e68d-698f-45db-80c0-abf5a7e307d6", "tag": "2624400e-a231-4c07-8001-9ca0b6756d63"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:24:12.076141 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-1886e880-2a13-42cb-8738-1e08f270ba19 req-224090a2-d343-47ed-b74e-5ead0c6dba10 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:12.076577 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-1886e880-2a13-42cb-8738-1e08f270ba19 req-224090a2-d343-47ed-b74e-5ead0c6dba10 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:12.089988 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-1886e880-2a13-42cb-8738-1e08f270ba19 req-224090a2-d343-47ed-b74e-5ead0c6dba10 service nova] Creating event network-changed:2624400e-a231-4c07-8001-9ca0b6756d63 for instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 on hv-cinder-84814 Jun 29 16:24:12.094914 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-1886e880-2a13-42cb-8738-1e08f270ba19 req-224090a2-d343-47ed-b74e-5ead0c6dba10 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031644 Jun 29 16:24:12.095691 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 652/1289] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:24:12.186474 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:12.187137 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:12.193659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:12.194108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:12.194861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:12.195292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:12.330980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:12.338951 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5bd10a2a-4e9b-4b54-833a-357270053dea tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.156615 Jun 29 16:24:12.339510 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 638/1290] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:12 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:13.357024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:13.357651 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:13.364007 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:13.364446 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:13.365187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:13.365611 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:13.497290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:13.504752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-73e53467-96ac-4161-83eb-010a0e235c48 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.152900 Jun 29 16:24:13.505315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 653/1291] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:13 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:14.524422 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:14.525583 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:14.534283 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:14.534720 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:14.535480 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:14.535936 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:14.669074 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:14.676507 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e15dca9f-b842-4e95-b255-cdb651a6dea4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.158465 Jun 29 16:24:14.677059 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 639/1292] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:14 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:15.693815 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:15.694428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:15.701794 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:15.702231 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:15.702974 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:15.703405 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:15.837698 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:15.845408 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-390fcdc4-a44f-44b9-ba17-4ec63ee0617a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.155469 Jun 29 16:24:15.845964 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 654/1293] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:15 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:16.862295 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:16.862988 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:16.869699 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:16.870153 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:16.870914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:16.871447 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:17.090192 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:17.097801 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bffbe48-e86e-4377-9caa-c375c07234a7 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.239429 Jun 29 16:24:17.098519 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 640/1294] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:16 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:18.116593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:18.117195 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:18.124221 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:18.124659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:18.125434 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:18.125860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:18.254214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:18.262033 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8f94156a-b95d-460b-9714-eb815688f4d2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.149296 Jun 29 16:24:18.262593 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 655/1295] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:18 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:19.279719 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:19.280356 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:19.282277 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:19.282931 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:19.289043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:19.289487 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:19.290238 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:19.290672 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:19.424047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:19.431378 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3acf2e7-0784-4ece-8b43-250b3a6802b8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.156256 Jun 29 16:24:19.431970 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 641/1296] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:19 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:20.447657 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:20.448233 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:20.450188 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell0:SELECT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:20.455873 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:20.456315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:20.457055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:20.457481 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:20.588485 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:20.595923 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c1114bd1-e945-4aa1-8b49-f9e8098776f1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.152170 Jun 29 16:24:20.596484 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 656/1297] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:20 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:21.613049 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:21.613654 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:21.620958 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:21.621342 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:21.622086 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:21.622512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:21.750782 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:21.758116 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-86806c37-659e-40df-b80b-018213d5f256 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.148923 Jun 29 16:24:21.758675 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 642/1298] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:21 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:22.774449 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:22.775057 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:22.781341 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:22.781783 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:22.782527 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:22.782959 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:22.909468 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:22.917378 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-eafc13ae-c7e1-4779-a57e-9af55bc26660 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.146764 Jun 29 16:24:22.917936 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 657/1299] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:22 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:23.934083 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:23.934688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:23.941179 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:23.941625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:23.942376 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:23.942810 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:24.078391 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:24.086061 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-37e7a194-a88d-4bb9-8ecb-545e2bb862a8 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.155886 Jun 29 16:24:24.086625 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 643/1300] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:23 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:25.102854 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:25.104068 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:25.110623 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:25.111070 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:25.111850 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:25.112285 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:25.248461 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:25.256105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0e5f778f-a87b-4bac-a8aa-cd3451874ab1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.157091 Jun 29 16:24:25.256705 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 658/1301] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:25 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:26.274987 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:26.276171 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:26.282661 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:26.283113 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:26.283895 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:26.284357 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:26.411224 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:26.419156 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d29e220-e570-4a3d-9db6-76042efc4171 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.148086 Jun 29 16:24:26.419709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 644/1302] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:26 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:27.436037 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:27.436654 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:27.443204 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:27.443639 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:27.444414 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:27.444838 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:27.580823 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:27.588502 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0925f833-d464-422c-a1df-a2eb7807ba66 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.156974 Jun 29 16:24:27.589178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 659/1303] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:27 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:28.605489 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:28.606117 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:28.612465 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:28.612914 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:28.613670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:28.614108 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:28.743094 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:28.751329 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-95c004cc-ecc5-4a84-9548-2168ddbb995c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.149915 Jun 29 16:24:28.751909 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 645/1304] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:28 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:29.768784 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:29.769382 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:29.776109 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:29.776557 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:29.777330 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:29.777757 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:29.907464 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:29.915205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-90b50824-ba05-4884-980d-963c4580238a tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.150385 Jun 29 16:24:29.915780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 660/1305] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:29 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:29.921925 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-7dd3909e-e7f0-4af3-8df2-2a569a24a7b2 req-2a26d2d5-2d80-48e5-a9cf-c994f64e022e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a8e68d-698f-45db-80c0-abf5a7e307d6", "name": "network-vif-plugged", "status": "completed", "tag": "2624400e-a231-4c07-8001-9ca0b6756d63"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:24:29.931627 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7dd3909e-e7f0-4af3-8df2-2a569a24a7b2 req-2a26d2d5-2d80-48e5-a9cf-c994f64e022e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:29.932276 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7dd3909e-e7f0-4af3-8df2-2a569a24a7b2 req-2a26d2d5-2d80-48e5-a9cf-c994f64e022e service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:29.944644 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-7dd3909e-e7f0-4af3-8df2-2a569a24a7b2 req-2a26d2d5-2d80-48e5-a9cf-c994f64e022e service nova] Creating event network-vif-plugged:2624400e-a231-4c07-8001-9ca0b6756d63 for instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 on hv-cinder-84814 Jun 29 16:24:29.950177 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-7dd3909e-e7f0-4af3-8df2-2a569a24a7b2 req-2a26d2d5-2d80-48e5-a9cf-c994f64e022e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032097 Jun 29 16:24:29.950757 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 646/1306] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:24:30.932014 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:30.932607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:30.939031 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:30.939468 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:30.940240 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:30.940665 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:30.958177 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:31.073067 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:31.080494 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-710e485f-c3da-473a-8696-31b66ad260ae tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.152446 Jun 29 16:24:31.081063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 661/1307] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:30 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:32.098769 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:32.099610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:32.106409 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:32.106854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:32.107604 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:32.108073 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:32.245677 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:32.254131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fe874441-1aa2-4373-9af6-1b5d0a24e9ba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1267 microversion: 2.1 time: 0.160034 Jun 29 16:24:32.254703 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 647/1308] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:32 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:33.271187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:33.271788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:33.278437 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:33.278882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:33.279634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:33.280088 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:33.417388 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:33.424885 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f97ae378-e808-440b-8e62-825f5c3077e4 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1454 microversion: 2.1 time: 0.157575 Jun 29 16:24:33.425451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 662/1309] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:33 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:33.441261 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:24:33.441869 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:24:33.448495 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:33.448944 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:33.449701 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:33.450131 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:33.589787 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:24:33.597416 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6ac75393-1e28-4a6d-bca6-aa782b9dd8df tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1454 microversion: 2.1 time: 0.159962 Jun 29 16:24:33.598024 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 648/1310] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:24:33 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:24:35.395613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-e2335e44-b18e-43cb-8144-ecdcb5cb88c5 req-6e28c456-5bcc-42cf-afa6-74614c7b8665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a8e68d-698f-45db-80c0-abf5a7e307d6", "tag": "2624400e-a231-4c07-8001-9ca0b6756d63"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:24:35.399413 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:35.406327 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-e2335e44-b18e-43cb-8144-ecdcb5cb88c5 req-6e28c456-5bcc-42cf-afa6-74614c7b8665 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:24:35.406567 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-e2335e44-b18e-43cb-8144-ecdcb5cb88c5 req-6e28c456-5bcc-42cf-afa6-74614c7b8665 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:24:35.419223 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-e2335e44-b18e-43cb-8144-ecdcb5cb88c5 req-6e28c456-5bcc-42cf-afa6-74614c7b8665 service nova] Creating event network-changed:2624400e-a231-4c07-8001-9ca0b6756d63 for instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 on hv-cinder-84814 Jun 29 16:24:35.424347 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-e2335e44-b18e-43cb-8144-ecdcb5cb88c5 req-6e28c456-5bcc-42cf-afa6-74614c7b8665 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168010 Jun 29 16:24:35.424934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 663/1311] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:25:03.394713 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:25:03.395185 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:26:23.663946 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:23.664624 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:23.669144 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:23.669667 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:23.677485 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:23.677918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:23.678669 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:23.679096 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:23.701920 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lazy-loading 'flavor' on Instance uuid f837002f-5720-4a10-9f1b-71fd8659019a {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 16:26:23.770660 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a220884-f7a6-4ce0-b1b2-eded317bd4f5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "POST /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a/action" status: 202 len: 0 microversion: 2.1 time: 0.108264 Jun 29 16:26:23.771242 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 649/1312] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:26:23 2022] POST /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:26:23.777992 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=10 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:23.778845 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:23.783595 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:23.784401 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:23.791618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:23.792120 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:23.792879 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:23.793340 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:24.155752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:24.163540 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-82d30710-d02a-4a60-a126-09c13cbd4f43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.387793 Jun 29 16:26:24.164128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 664/1313] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:23 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:25.183735 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:25.184450 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:25.191249 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:25.191688 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:25.192455 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:25.192886 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:25.380358 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:25.387777 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ffd2e506-fa72-4022-b101-da64e95e42e5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.208928 Jun 29 16:26:25.388365 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 650/1314] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:25 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:26.404396 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:26.404949 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:26.412081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:26.412525 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:26.413273 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:26.413702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:26.539052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:26.546574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-942d7718-b351-408b-8dae-f1fa9ba4b360 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.146089 Jun 29 16:26:26.547130 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 665/1315] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:26 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:27.562623 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:27.563718 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:27.570289 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:27.570742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:27.571501 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:27.571990 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:27.705542 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:27.713183 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d7db2eb0-b124-4656-8c62-c4be09267d3c tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.154588 Jun 29 16:26:27.713743 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 651/1316] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:27 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:28.729965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:28.730597 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:28.737702 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:28.738140 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:28.738881 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:28.739304 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:28.867604 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:28.875436 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-e4283b7f-3767-46b1-9e3c-9b797157f3ad tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.149333 Jun 29 16:26:28.876571 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 666/1317] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:28 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:29.893436 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:29.894043 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:29.900512 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:29.900954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:29.901695 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:29.902121 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:30.028478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:30.036399 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-72a4f0b5-6e6b-4cd5-af0a-920682e69da8 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.147158 Jun 29 16:26:30.036971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 652/1318] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:29 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:31.053318 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:31.053975 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:31.060462 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:31.060912 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:31.061664 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:31.062095 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:31.188632 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:31.196105 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-52a6dcef-1be2-4165-83f3-17528b444248 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.146627 Jun 29 16:26:31.196668 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 667/1319] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:31 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:32.213350 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:32.213954 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:32.220477 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:32.220918 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:32.221665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:32.222091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:32.352907 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:32.360843 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dffd00a6-a355-4837-a9a6-6763043d749b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.151338 Jun 29 16:26:32.361400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 653/1320] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:32 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:33.378388 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:33.379003 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:33.385607 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:33.386055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:33.386811 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:33.387244 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:33.521802 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:33.529267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-6cd4570f-7753-4583-ae16-1d2ea01aaa33 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.155369 Jun 29 16:26:33.529868 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 668/1321] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:33 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:34.547003 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:34.548239 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:34.554681 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:34.555125 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:34.555897 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:34.556328 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:34.689047 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:34.696372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b5b7bddf-038c-4075-92d7-6d86a564278e tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.153808 Jun 29 16:26:34.696958 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 654/1322] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:34 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:35.713444 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:35.714128 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:35.721435 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:35.721882 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:35.722635 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:35.723063 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:36.192659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:36.200142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5dc73ba0-69e7-4bf2-b956-fe2cd7aa5a19 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.490535 Jun 29 16:26:36.200714 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 669/1323] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:35 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:26:36.365689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:26:36.365892 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Wed Jun 29 16:26:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:26:36.379331 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:36.379862 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:36.382492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-db55b353-4e7f-48fc-9e6d-8c49e5a5f5d9 req-803014e7-6845-4a9c-856b-7be436b59b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a8e68d-698f-45db-80c0-abf5a7e307d6", "tag": "2624400e-a231-4c07-8001-9ca0b6756d63"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:36.386710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:36.387446 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:36.388403 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:36.389022 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:36.390758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-db55b353-4e7f-48fc-9e6d-8c49e5a5f5d9 req-803014e7-6845-4a9c-856b-7be436b59b11 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:36.391750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-db55b353-4e7f-48fc-9e6d-8c49e5a5f5d9 req-803014e7-6845-4a9c-856b-7be436b59b11 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:36.403037 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-db55b353-4e7f-48fc-9e6d-8c49e5a5f5d9 req-803014e7-6845-4a9c-856b-7be436b59b11 service nova] Creating event network-changed:2624400e-a231-4c07-8001-9ca0b6756d63 for instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 on hv-cinder-84814 Jun 29 16:26:36.409110 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-db55b353-4e7f-48fc-9e6d-8c49e5a5f5d9 req-803014e7-6845-4a9c-856b-7be436b59b11 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030237 Jun 29 16:26:36.409912 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 670/1324] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 16:26:36.417005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:26:36.497670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-976b195f-7a51-4afd-b0fc-9f9f3d78dfba tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 204 len: 0 microversion: 2.1 time: 0.125267 Jun 29 16:26:36.501344 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 655/1325] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:26:36 2022] DELETE /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:26:36.508211 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:36.509064 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:36.515350 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:36.515806 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:36.517184 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:36.517618 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:36.651617 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:36.659803 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-233f89c9-0454-42df-bb23-732e1bc718f2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1579 microversion: 2.1 time: 0.156941 Jun 29 16:26:36.669537 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 671/1326] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:36 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:37.218161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:37.218854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:37.225174 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:37.225615 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:37.226369 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:37.226796 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:37.371603 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:37.380102 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49ef5e9d-b818-40bb-9872-6ebb337b0408 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.166046 Jun 29 16:26:37.380867 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 656/1327] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:37 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:37.677807 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:37.679052 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:37.685512 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:37.686254 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:37.687016 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:37.687442 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:37.819847 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:37.827356 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-540d414b-663f-4aa1-8499-712acedb9f3e tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1579 microversion: 2.1 time: 0.153453 Jun 29 16:26:37.827941 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 672/1328] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:37 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:38.397754 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:38.398355 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:38.404802 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.405297 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.406091 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.408649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.673200 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:38.680766 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9f214fb-2677-45d1-bef8-6d915e6e6f39 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1569 microversion: 2.1 time: 0.286838 Jun 29 16:26:38.681651 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 657/1329] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:38 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1569 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:38.698066 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:38.698699 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:38.705205 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.705649 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.706391 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.706818 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.785206 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-85a683a5-26a7-4361-808a-66bb1a817edf tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "POST /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a/action" status: 202 len: 0 microversion: 2.1 time: 0.090925 Jun 29 16:26:38.785995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 673/1330] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jun 29 16:26:38 2022] POST /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:26:38.794182 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:38.794892 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:38.804080 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.804526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.813999 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.814472 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.848319 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:38.848927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:38.855797 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.856322 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:38.857126 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:38.857555 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:39.021642 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:39.029817 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-abad85f7-9e26-4225-91fa-2b189668b59c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 200 len: 1460 microversion: 2.1 time: 0.189119 Jun 29 16:26:39.043267 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 674/1331] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:38 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 1460 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:39.046160 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:39.056170 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4ab6e8a0-b67a-440f-b41c-ef9f606b70f4 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1517 microversion: 2.1 time: 0.266024 Jun 29 16:26:39.057290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 658/1332] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:38 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:26:39.334077 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-b6a74f75-58c9-4751-b70d-cdbebd3a968d req-926c03c7-bf57-4ac3-ac41-0f44563200a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a8e68d-698f-45db-80c0-abf5a7e307d6", "name": "network-vif-deleted", "tag": "2624400e-a231-4c07-8001-9ca0b6756d63"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:39.342441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-b6a74f75-58c9-4751-b70d-cdbebd3a968d req-926c03c7-bf57-4ac3-ac41-0f44563200a1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:39.342887 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-b6a74f75-58c9-4751-b70d-cdbebd3a968d req-926c03c7-bf57-4ac3-ac41-0f44563200a1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:39.354800 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-b6a74f75-58c9-4751-b70d-cdbebd3a968d req-926c03c7-bf57-4ac3-ac41-0f44563200a1 service nova] Creating event network-vif-deleted:2624400e-a231-4c07-8001-9ca0b6756d63 for instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 on hv-cinder-84814 Jun 29 16:26:39.359961 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-b6a74f75-58c9-4751-b70d-cdbebd3a968d req-926c03c7-bf57-4ac3-ac41-0f44563200a1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096191 Jun 29 16:26:39.360608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 675/1333] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:26:40.048335 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:40.048937 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: d9a8e68d-698f-45db-80c0-abf5a7e307d6] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:40.055607 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:40.056072 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:40.056956 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:40.057361 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:40.072259 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] HTTP exception thrown: Instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 could not be found. Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Request method failure captured: Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 HTTP/1.1 Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHsV1QD_YkCp6PFLB91BQMqAg8JJsm7wCCOSoNCnNxnTGebyqKYF3b7uzayZcqc2D5XTAbVufU9_wvKucFNxZEsljmfWDadYOmS8n21bVXa8X6-mz4cu9X_T3vu-YO3Q8ZvNcSJ0RX0F2LFGKifh6iW7HkQhX0D_ObC6xEDS5sWN-js Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:26:40.073964 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c561382be984c2b9c1285c6e5b6268a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: da01cd253f6e4bc792868f337ff85b0a Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 could not be found. Jun 29 16:26:40.075678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': 'd9a8e68d-698f-45db-80c0-abf5a7e307d6'} Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 could not be found. Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:26:40.076756 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 could not be found. Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 could not be found. Jun 29 16:26:40.082368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:40.083940 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Returning 404 to user: Instance d9a8e68d-698f-45db-80c0-abf5a7e307d6 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:26:40.084054 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:40.084478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a158900-15e5-484d-935a-ba096cdef4dc tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6" status: 404 len: 111 microversion: 2.1 time: 0.031705 Jun 29 16:26:40.084478 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 659/1334] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:40 2022] GET /compute/v2.1/servers/d9a8e68d-698f-45db-80c0-abf5a7e307d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:26:40.084750 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:40.098439 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:40.099174 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:40.100613 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:40.101627 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:40.254402 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:40.262053 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2f5e92ea-07ae-4a5e-92ee-dd8cc4c9f604 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1519 microversion: 2.1 time: 0.192159 Jun 29 16:26:40.262634 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 676/1335] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:40 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:26:40.570423 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-1d2524e9-e67c-4561-9916-8bc33b6a5fac req-72bdbd92-4170-43eb-8609-3f0e5f96dc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "name": "network-vif-unplugged", "status": "completed", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:40.578608 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1d2524e9-e67c-4561-9916-8bc33b6a5fac req-72bdbd92-4170-43eb-8609-3f0e5f96dc87 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:40.579069 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1d2524e9-e67c-4561-9916-8bc33b6a5fac req-72bdbd92-4170-43eb-8609-3f0e5f96dc87 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:40.590356 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-1d2524e9-e67c-4561-9916-8bc33b6a5fac req-72bdbd92-4170-43eb-8609-3f0e5f96dc87 service nova] Creating event network-vif-unplugged:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:26:40.595759 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-1d2524e9-e67c-4561-9916-8bc33b6a5fac req-72bdbd92-4170-43eb-8609-3f0e5f96dc87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029148 Jun 29 16:26:40.596394 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 660/1336] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:26:41.279286 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:41.279860 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:41.286689 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:41.287145 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:41.288010 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:41.288448 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:41.421115 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:41.428601 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8d3ea661-2f61-4d0a-9722-17c66b1f7422 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.153889 Jun 29 16:26:41.429152 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 677/1337] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:41 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:42.447158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:42.447932 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:42.454801 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:42.455240 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:42.456029 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:42.456470 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:42.664100 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:42.671533 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ccda682e-fc68-411e-8ee9-14d5c22162dd tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.229092 Jun 29 16:26:42.672117 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 661/1338] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:42 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:43.227155 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:43.232534 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-6d1151f9-3d50-4591-804e-a17e3dc79e3e req-8a003ad9-19db-49fc-b744-3900371d967b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5617b152-0a28-4c51-98ac-11a45008d37f", "tag": "f5672af0-3e3f-4d09-9fb4-77322e497ab8"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:43.236857 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:43.243574 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.243764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6d1151f9-3d50-4591-804e-a17e3dc79e3e req-8a003ad9-19db-49fc-b744-3900371d967b service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.244055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.244198 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6d1151f9-3d50-4591-804e-a17e3dc79e3e req-8a003ad9-19db-49fc-b744-3900371d967b service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.244816 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.245245 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.257694 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-6d1151f9-3d50-4591-804e-a17e3dc79e3e req-8a003ad9-19db-49fc-b744-3900371d967b service nova] Creating event network-changed:f5672af0-3e3f-4d09-9fb4-77322e497ab8 for instance 5617b152-0a28-4c51-98ac-11a45008d37f on hv-cinder-84814 Jun 29 16:26:43.262605 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-6d1151f9-3d50-4591-804e-a17e3dc79e3e req-8a003ad9-19db-49fc-b744-3900371d967b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Jun 29 16:26:43.263706 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 662/1339] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:26:43.273178 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:26:43.355886 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-843fd7d6-59e7-407a-8a16-6f694501eccb tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 204 len: 0 microversion: 2.1 time: 0.132235 Jun 29 16:26:43.357035 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 678/1340] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:26:43 2022] DELETE /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:26:43.366005 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:43.366953 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:43.373846 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.374913 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.376287 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.376722 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.689741 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:43.690748 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:43.697353 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.697801 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.698568 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:43.698995 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:43.705897 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:43.848418 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:43.865073 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-90ba9884-9911-4607-854c-d2536845ce13 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.180073 Jun 29 16:26:43.865861 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 679/1341] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:43 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:26:43.872221 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:43.876961 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:43.882526 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9786208e-7ea1-40dc-9469-032c96357ffa tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1579 microversion: 2.1 time: 0.521034 Jun 29 16:26:43.883292 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 663/1342] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:43 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1579 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:26:44.882315 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:44.882934 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:44.889374 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:44.889822 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:44.890569 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:44.891655 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:44.900222 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:44.900854 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:44.908672 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:44.909114 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:44.909861 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:44.910290 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:44.974161 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da01cd253f6e4bc792868f337ff85b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561382be984c2b9c1285c6e5b6268a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:44.981959 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-733e9760-4537-4bf7-bb5d-ddfef8cf2da1 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 200 len: 1226 microversion: 2.1 time: 0.085923 Jun 29 16:26:44.983178 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 664/1343] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:44 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:26:45.026428 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:45.034027 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-8aee155b-9daf-4603-b0d6-76555769286a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.155516 Jun 29 16:26:45.034586 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 680/1344] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:44 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:45.277761 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8f00d239-d565-4718-85b3-3c26cdad2860 req-62dfdacb-cf68-4cfb-8cd8-0207f0876a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5617b152-0a28-4c51-98ac-11a45008d37f", "name": "network-vif-deleted", "tag": "f5672af0-3e3f-4d09-9fb4-77322e497ab8"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:45.285755 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8f00d239-d565-4718-85b3-3c26cdad2860 req-62dfdacb-cf68-4cfb-8cd8-0207f0876a3b service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:45.286207 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8f00d239-d565-4718-85b3-3c26cdad2860 req-62dfdacb-cf68-4cfb-8cd8-0207f0876a3b service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:45.297642 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8f00d239-d565-4718-85b3-3c26cdad2860 req-62dfdacb-cf68-4cfb-8cd8-0207f0876a3b service nova] Creating event network-vif-deleted:f5672af0-3e3f-4d09-9fb4-77322e497ab8 for instance 5617b152-0a28-4c51-98ac-11a45008d37f on hv-cinder-84814 Jun 29 16:26:45.302584 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8f00d239-d565-4718-85b3-3c26cdad2860 req-62dfdacb-cf68-4cfb-8cd8-0207f0876a3b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028517 Jun 29 16:26:45.303169 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 665/1345] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:26:45.999112 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:45.999695 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 5617b152-0a28-4c51-98ac-11a45008d37f] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:46.006780 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.007222 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.007996 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.008423 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.021470 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] HTTP exception thrown: Instance 5617b152-0a28-4c51-98ac-11a45008d37f could not be found. Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Request method failure captured: Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f HTTP/1.1 Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHsV1QD_YkCp6PFLB91BQMqAg8JJsm7wCCOSoNCnNxnTGebyqKYF3b7uzayZcqc2D5XTAbVufU9_wvKucFNxZEsljmfWDadYOmS8n21bVXa8X6-mz4cu9X_T3vu-YO3Q8ZvNcSJ0RX0F2LFGKifh6iW7HkQhX0D_ObC6xEDS5sWN-js Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:26:46.023055 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c561382be984c2b9c1285c6e5b6268a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: da01cd253f6e4bc792868f337ff85b0a Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 5617b152-0a28-4c51-98ac-11a45008d37f could not be found. Jun 29 16:26:46.024776 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '5617b152-0a28-4c51-98ac-11a45008d37f'} Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5617b152-0a28-4c51-98ac-11a45008d37f could not be found. Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:26:46.025739 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5617b152-0a28-4c51-98ac-11a45008d37f could not be found. Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5617b152-0a28-4c51-98ac-11a45008d37f could not be found. Jun 29 16:26:46.027346 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.028788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Returning 404 to user: Instance 5617b152-0a28-4c51-98ac-11a45008d37f could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:26:46.028788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-25bafcdd-523f-43a0-9b40-c45d2b676a25 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f" status: 404 len: 111 microversion: 2.1 time: 0.029279 Jun 29 16:26:46.028788 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 681/1346] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:45 2022] GET /compute/v2.1/servers/5617b152-0a28-4c51-98ac-11a45008d37f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:26:46.051552 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:46.052269 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:46.058923 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.059366 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.060150 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.060589 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.287742 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:46.295232 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9ac0ee3a-7c58-4762-a9ee-fa41e2e25c86 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.248490 Jun 29 16:26:46.295793 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 666/1347] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:46 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:46.540566 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:46.540986 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:46.547040 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.548250 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.549024 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.549451 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.562560 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.wsgi [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] HTTP exception thrown: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Request method failure captured: Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: request: DELETE /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd HTTP/1.1 Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept: application/json Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Accept-Encoding: identity Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Connection: close Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Length: 0 Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Content-Type: application/json Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Host: 10.222.0.47 Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Openstack-System-Scope: None Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: User-Agent: python-urllib3/1.26.9 Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Auth-Token: gAAAAABivHsV1QD_YkCp6PFLB91BQMqAg8JJsm7wCCOSoNCnNxnTGebyqKYF3b7uzayZcqc2D5XTAbVufU9_wvKucFNxZEsljmfWDadYOmS8n21bVXa8X6-mz4cu9X_T3vu-YO3Q8ZvNcSJ0RX0F2LFGKifh6iW7HkQhX0D_ObC6xEDS5sWN-js Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Id: None Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Domain-Name: None Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Identity-Status: Confirmed Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Is-Admin-Project: True Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Id: default Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Domain-Name: Default Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Project-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Role: reader,member Jun 29 16:26:46.564076 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Roles: reader,member Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c561382be984c2b9c1285c6e5b6268a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Id: default Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Domain-Name: Default Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Id: da01cd253f6e4bc792868f337ff85b0a Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: X-User-Name: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: method: > Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: exception: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.565852 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: action_args: {'id': '84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd'} Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:26:46.567032 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.568767 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.570365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Returning 404 to user: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. {{(pid=117728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:26:46.570365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-2f00bf82-42cd-4579-bd5a-2fcdadf058b2 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "DELETE /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 404 len: 111 microversion: 2.1 time: 0.028794 Jun 29 16:26:46.570365 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 682/1348] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:26:46 2022] DELETE /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:26:46.574055 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:46.574665 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] [instance: 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:46.580751 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.581195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.581943 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:46.582377 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:46.596065 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] HTTP exception thrown: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Request method failure captured: Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd HTTP/1.1 Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHsV1QD_YkCp6PFLB91BQMqAg8JJsm7wCCOSoNCnNxnTGebyqKYF3b7uzayZcqc2D5XTAbVufU9_wvKucFNxZEsljmfWDadYOmS8n21bVXa8X6-mz4cu9X_T3vu-YO3Q8ZvNcSJ0RX0F2LFGKifh6iW7HkQhX0D_ObC6xEDS5sWN-js Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:26:46.597693 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c561382be984c2b9c1285c6e5b6268a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c561382be984c2b9c1285c6e5b6268a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8c561382be984c2b9c1285c6e5b6268a Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestVolumeBootPattern-1867006822 Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: da01cd253f6e4bc792868f337ff85b0a Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestVolumeBootPattern-1867006822-project Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.599362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': '84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd'} Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:26:46.600362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. Jun 29 16:26:46.601922 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:26:46.603454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Returning 404 to user: Instance 84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:26:46.603454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-08fa0a17-3786-43b2-8295-cbf34d592f2c tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd" status: 404 len: 111 microversion: 2.1 time: 0.028926 Jun 29 16:26:46.603454 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 667/1349] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:46 2022] GET /compute/v2.1/servers/84e3d1c0-1d4f-4ad0-be6f-5726c191b5cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:26:47.312559 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:47.313684 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:47.320225 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:47.320675 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:47.321431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:47.321867 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:47.454967 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:47.462497 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-cea2dbc0-6bda-40fc-8a15-f739bfdd1c4a tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.153843 Jun 29 16:26:47.463059 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 683/1350] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:47 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:47.880659 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f9aaa021-7080-4ec3-8cf6-c5f96b46bd74 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] Calling method '.version_select at 0x7f04350334c0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:47.906128 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f9aaa021-7080-4ec3-8cf6-c5f96b46bd74 tempest-TestVolumeBootPattern-1867006822 tempest-TestVolumeBootPattern-1867006822-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1528332792" status: 202 len: 0 microversion: 2.1 time: 0.029123 Jun 29 16:26:47.907097 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 668/1351] 10.222.0.47 () {58 vars in 1262 bytes} [Wed Jun 29 16:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1528332792 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:26:48.478473 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:48.479092 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:48.485680 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:48.486127 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:48.486884 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:48.487314 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:48.630279 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:48.638399 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-5333ed09-67a0-4800-9914-b49a655ee52d tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.163749 Jun 29 16:26:48.638965 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 684/1352] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:48 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:49.655929 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:49.656971 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:49.664494 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:49.664939 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:49.665710 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:49.666146 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:49.891622 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:49.899709 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-abce6d41-e584-49f3-bd4a-28387e4586bb tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.247910 Jun 29 16:26:49.900490 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 669/1353] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:49 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:50.712041 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [req-740aa85d-0fbc-41bf-bfa3-3f233d0850d5 req-6f71b192-9180-4bc4-aa72-3ca69d86c5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "name": "network-vif-plugged", "status": "completed", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:26:50.720902 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-740aa85d-0fbc-41bf-bfa3-3f233d0850d5 req-6f71b192-9180-4bc4-aa72-3ca69d86c5a4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:50.721648 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [req-740aa85d-0fbc-41bf-bfa3-3f233d0850d5 req-6f71b192-9180-4bc4-aa72-3ca69d86c5a4 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:50.733752 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.compute.server_external_events [req-740aa85d-0fbc-41bf-bfa3-3f233d0850d5 req-6f71b192-9180-4bc4-aa72-3ca69d86c5a4 service nova] Creating event network-vif-plugged:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:26:50.739796 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [req-740aa85d-0fbc-41bf-bfa3-3f233d0850d5 req-6f71b192-9180-4bc4-aa72-3ca69d86c5a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 Jun 29 16:26:50.740786 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 685/1354] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:26:50.918959 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:50.919621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:50.929649 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:50.930158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:50.931115 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:50.931904 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:51.222670 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:51.231479 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b01f773-5344-4167-b29a-a0e54edf3846 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.316791 Jun 29 16:26:51.232090 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 670/1355] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:50 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:52.250043 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:52.250742 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:52.257841 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:52.258284 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:52.259029 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:52.259455 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:52.411290 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:52.419097 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-c161bcb7-49d6-4627-bcc8-6033af53025b tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1575 microversion: 2.1 time: 0.173806 Jun 29 16:26:52.428769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 686/1356] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:52 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:26:53.436195 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:26:53.436807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:26:53.443466 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:53.443934 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:53.444678 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:26:53.445107 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:26:53.681062 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:26:53.696610 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34044f6c-1dcc-440e-98a1-c648d2b98a43 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1562 microversion: 2.1 time: 0.263902 Jun 29 16:26:53.697243 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 671/1357] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:26:53 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:28:23.660606 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:23.661342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG dbcounter [-] [117728] Writing DB stats nova_cell1:SELECT=34 {{(pid=117728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:23.665255 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:28:23.665751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:28:23.670702 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:23.671439 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=34 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:23.675764 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-30136cd5-5c0f-4ca4-bf0a-d7fad4578b6b req-c2033c77-6d36-4938-b719-4bfb62f4fcea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:28:23.685769 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:23.686214 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:23.686985 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:23.687416 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:23.693524 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-30136cd5-5c0f-4ca4-bf0a-d7fad4578b6b req-c2033c77-6d36-4938-b719-4bfb62f4fcea service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:23.693963 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-30136cd5-5c0f-4ca4-bf0a-d7fad4578b6b req-c2033c77-6d36-4938-b719-4bfb62f4fcea service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:23.709228 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-30136cd5-5c0f-4ca4-bf0a-d7fad4578b6b req-c2033c77-6d36-4938-b719-4bfb62f4fcea service nova] Creating event network-changed:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:28:23.714464 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-30136cd5-5c0f-4ca4-bf0a-d7fad4578b6b req-c2033c77-6d36-4938-b719-4bfb62f4fcea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045373 Jun 29 16:28:23.715132 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 672/1358] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:28:23.727108 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Going to try to terminate instance {{(pid=117728) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 16:28:23.808920 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-242699ea-71ae-412f-979b-114105db0c97 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 204 len: 0 microversion: 2.1 time: 0.150044 Jun 29 16:28:23.809520 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 687/1359] 10.222.0.47 () {58 vars in 1238 bytes} [Wed Jun 29 16:28:23 2022] DELETE /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 16:28:23.818268 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:28:23.818965 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:28:23.825492 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:23.825941 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:23.826705 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:23.827139 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:24.000777 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:28:24.008621 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-17cfe4a4-6e79-4198-a5e3-43f9c3e100a5 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.194503 Jun 29 16:28:24.009387 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 673/1360] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:28:23 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:28:25.026608 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:28:25.027309 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:28:25.033909 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:25.034361 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:25.035146 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:25.035614 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:25.171970 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:28:25.179927 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-f2ffb607-08e3-4591-b037-16c10838bc85 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1568 microversion: 2.1 time: 0.157557 Jun 29 16:28:25.180492 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 688/1361] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:28:25 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 16:28:26.111590 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8c226bec-850a-4f44-9783-13736013711c req-a812eb5a-19a8-4373-8461-00889490c8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f837002f-5720-4a10-9f1b-71fd8659019a", "name": "network-vif-deleted", "tag": "a41e605c-bbc4-42b0-9493-d3e12eca2af5"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 16:28:26.122133 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8c226bec-850a-4f44-9783-13736013711c req-a812eb5a-19a8-4373-8461-00889490c8a1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:26.122574 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8c226bec-850a-4f44-9783-13736013711c req-a812eb5a-19a8-4373-8461-00889490c8a1 service nova] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:26.135787 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8c226bec-850a-4f44-9783-13736013711c req-a812eb5a-19a8-4373-8461-00889490c8a1 service nova] Creating event network-vif-deleted:a41e605c-bbc4-42b0-9493-d3e12eca2af5 for instance f837002f-5720-4a10-9f1b-71fd8659019a on hv-cinder-84814 Jun 29 16:28:26.141007 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8c226bec-850a-4f44-9783-13736013711c req-a812eb5a-19a8-4373-8461-00889490c8a1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032956 Jun 29 16:28:26.141837 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 674/1362] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jun 29 16:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 16:28:26.197062 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:28:26.197766 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.compute.api [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117728) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:28:26.204431 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:26.204933 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:26.205751 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:26.206730 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG oslo_concurrency.lockutils [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:26.266187 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.policy [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e6d79984cf458fa07e9997bbb9a6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f643c76310b494cad1dbe8400b50e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117728) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 16:28:26.276758 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-ed4df816-929a-4052-bd73-b3f02a7f7124 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 200 len: 1219 microversion: 2.1 time: 0.083412 Jun 29 16:28:26.277342 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 689/1363] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:28:26 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 16:28:27.293995 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:28:27.294684 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] [instance: f837002f-5720-4a10-9f1b-71fd8659019a] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 16:28:27.301362 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:27.301807 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:27.302606 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 16:28:27.302988 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Lock "d1751ca9-4b08-41b0-bc86-296f8d8ee904" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 16:28:27.315980 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] HTTP exception thrown: Instance f837002f-5720-4a10-9f1b-71fd8659019a could not be found. Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Request method failure captured: Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a HTTP/1.1 Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Connection: close Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Host: 10.222.0.47 Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABivHw0ccZsb5zVYNLGbjmdnOJh_ftzpQqRe2udpycbplsxEYYN54-FNmFhTBCprZzupWttwL0gZXGOeTba4GNoWiOjLTXZsqpz3nXMjrRRXeerVDXUsPbxEPUkvLoEzje_oe8jpcCBOIIGUDKu6XZdbYihjZhk2zcJxK-WZdoz0rihN9I Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Id: 4f643c76310b494cad1dbe8400b50e49 Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestShelveInstance-1166245928 Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 29 16:28:27.317570 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4f643c76310b494cad1dbe8400b50e49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4f643c76310b494cad1dbe8400b50e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4f643c76310b494cad1dbe8400b50e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4f643c76310b494cad1dbe8400b50e49", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestShelveInstance-1166245928 Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 4f643c76310b494cad1dbe8400b50e49 Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestShelveInstance-1166245928 Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User: tempest-TestShelveInstance-1166245928-project Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Id: 55e6d79984cf458fa07e9997bbb9a6cb Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestShelveInstance-1166245928-project Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: method: > Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: exception: Instance f837002f-5720-4a10-9f1b-71fd8659019a could not be found. Jun 29 16:28:27.319400 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: action_args: {'id': 'f837002f-5720-4a10-9f1b-71fd8659019a'} Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f837002f-5720-4a10-9f1b-71fd8659019a could not be found. Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 16:28:27.320673 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f837002f-5720-4a10-9f1b-71fd8659019a could not be found. Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f837002f-5720-4a10-9f1b-71fd8659019a could not be found. Jun 29 16:28:27.322459 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 29 16:28:27.324037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Returning 404 to user: Instance f837002f-5720-4a10-9f1b-71fd8659019a could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 16:28:27.324037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9cd7fc73-6b67-4a7c-a7a1-baf635192a38 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a" status: 404 len: 111 microversion: 2.1 time: 0.029183 Jun 29 16:28:27.324037 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 675/1364] 10.222.0.47 () {58 vars in 1235 bytes} [Wed Jun 29 16:28:27 2022] GET /compute/v2.1/servers/f837002f-5720-4a10-9f1b-71fd8659019a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 16:28:27.476394 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: DEBUG nova.api.openstack.wsgi [None req-0af10398-456e-498e-b19a-630b23097bb1 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] Calling method '.version_select at 0x7f0434af6550>' {{(pid=117728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 16:28:27.497081 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO nova.api.openstack.requestlog [None req-0af10398-456e-498e-b19a-630b23097bb1 tempest-TestShelveInstance-1166245928 tempest-TestShelveInstance-1166245928-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-232455952" status: 202 len: 0 microversion: 2.1 time: 0.024543 Jun 29 16:28:27.497971 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: [pid: 117728|app: 0|req: 690/1365] 10.222.0.47 () {58 vars in 1250 bytes} [Wed Jun 29 16:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-232455952 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 16:30:02.321899 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:30:02.323102 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:30:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:30:03.406349 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:30:03.406911 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:31:36.377441 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:31:36.377920 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Wed Jun 29 16:31:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:31:43.553093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:31:43.553093 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Wed Jun 29 16:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:33:22.330844 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:33:22.331368 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:33:23.414372 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:33:23.415000 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:33:40.546659 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:33:40.547142 dv-cinder-848147-1-iscsi devstack@n-api.service[117728]: Wed Jun 29 16:33:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 16:33:42.670538 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 16:33:42.671158 dv-cinder-848147-1-iscsi devstack@n-api.service[117727]: Wed Jun 29 16:33:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!